-- Logs begin at Wed 2022-08-31 10:01:03 UTC, end at Wed 2022-08-31 11:03:01 UTC. -- Aug 31 10:29:17.007559 dv-cinder-846173-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:29:17 2022] *** Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: nodename: dv-cinder-846173-5-smb Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: machine: x86_64 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: clock source: unix Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: pcre jit disabled Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: detected number of CPU cores: 4 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: current working directory: / Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: your processes number limit is 47680 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: your memory page size is 4096 bytes Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: detected max file descriptor number: 2048 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: lock engine: pthread robust mutexes Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: thunder lock: enabled Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 10:29:17.020577 dv-cinder-846173-5-smb devstack@keystone.service[81663]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:29:17.060156 dv-cinder-846173-5-smb devstack@keystone.service[81663]: Python main interpreter initialized at 0x5643f1da59c0 Aug 31 10:29:17.060156 dv-cinder-846173-5-smb devstack@keystone.service[81663]: python threads support enabled Aug 31 10:29:17.060156 dv-cinder-846173-5-smb devstack@keystone.service[81663]: your server socket listen backlog is limited to 100 connections Aug 31 10:29:17.060156 dv-cinder-846173-5-smb devstack@keystone.service[81663]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:29:17.060516 dv-cinder-846173-5-smb devstack@keystone.service[81663]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:29:17.060516 dv-cinder-846173-5-smb devstack@keystone.service[81663]: *** Operational MODE: preforking *** Aug 31 10:29:17.060776 dv-cinder-846173-5-smb devstack@keystone.service[81663]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:29:17.060776 dv-cinder-846173-5-smb devstack@keystone.service[81663]: spawned uWSGI master process (pid: 81663) Aug 31 10:29:17.060984 dv-cinder-846173-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 10:29:17.064125 dv-cinder-846173-5-smb devstack@keystone.service[81663]: spawned uWSGI worker 1 (pid: 81677, cores: 1) Aug 31 10:29:17.064125 dv-cinder-846173-5-smb devstack@keystone.service[81663]: spawned uWSGI worker 2 (pid: 81678, cores: 1) Aug 31 10:29:17.064125 dv-cinder-846173-5-smb devstack@keystone.service[81663]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:29:21.423411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:29:21.423411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: from cryptography.utils import int_from_bytes Aug 31 10:29:21.424225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:29:21.424225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: from cryptography.utils import int_from_bytes Aug 31 10:29:21.429675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:29:21.429675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: from cryptography.utils import int_from_bytes Aug 31 10:29:21.430135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:29:21.430135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: from cryptography.utils import int_from_bytes Aug 31 10:29:21.474506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:29:21.474691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:29:21.474870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] command line args: [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:29:21.475135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:29:21.475311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ================================================================================ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:29:21.475562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] admin_token = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.475916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_dir = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.476108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.476290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] config_source = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.476470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] debug = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.476663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.477983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.477983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.477983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.477983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.477983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.478554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_config_append = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.478554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.478554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_dir = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.478554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.479990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.480229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.480470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.480700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.480964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.481196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.481428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.481674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.481915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.482202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.482362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:29:21.482572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:29:21.482679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.482768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] command line args: [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:29:21.482846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] publish_errors = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:29:21.483126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ================================================================================ {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:29:21.483279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] admin_token = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] config_dir = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.483939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] config_source = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] standard_threads = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] debug = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.484934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_journal = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_json = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_stderr = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] use_syslog = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_config_append = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.485849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.485935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.486007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_dir = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.486080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.486188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_file = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.486327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.486411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.486566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.486649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.486811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.486907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.487048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.487136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.487293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.487372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.487450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.487521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.487699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.487776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.487944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.488031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.488180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.488256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.488413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.488500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.488647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.488808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.488909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.488987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.489158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.489234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.489401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.489487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.489636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.489719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.489887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.490138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.490213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.490326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] publish_errors = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.490409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.490561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.490644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.490792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.490871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.490972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.491083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.491221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.491332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.491460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.491579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.491701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] standard_threads = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.491814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.491940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.492045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.492184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.492262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.492364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.492492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.492569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] use_journal = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.492708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] use_json = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.492888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.492968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] use_stderr = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.493045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.493115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] use_syslog = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.493210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.493288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:29:21.493437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.494955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.495951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.496944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.497935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.498958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.499894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.500999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.501956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.502993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.503959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.504893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.505949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.506987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.507936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.508930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.509005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.509088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.509263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.509878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.510964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.511948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.external = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.512968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.password = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] auth.token = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.513955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.514913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.515859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.516839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.517965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.518990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.519952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.520944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.external = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521551 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.521876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.password = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] auth.token = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.522596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.523933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.524940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.525973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.526964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.527891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.528946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.529965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.530982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.531913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.532905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.533845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.534945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.535975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.536977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.537955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.538979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.539923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.540928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.541879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.542939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.543998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.544993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.545948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.546889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.547840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.548984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.549951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.550914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.551882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.552989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.553967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.554977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] role.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.555934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] role.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.556600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.556777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.556862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.557975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.558967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.559950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.560929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.561901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.562849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.563859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81677) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:29:21.563965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.564222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.564473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.564714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.564980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.565217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.565459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.565701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.565955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.566197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.566457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.566707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.566951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.567200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.567451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.567702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.567945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.568186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.568426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.568675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.568980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.569215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.569463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.569735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.569999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.connection = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.570248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.570498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.570740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.570985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.571224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.571465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.571726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.573045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.573309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.573558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.573811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.574054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.574307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.574548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.574800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.575037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.575285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.575527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:29:21.575701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81678) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:29:21.593510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.593736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.593961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.600912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.601149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.601379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.602250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.610363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.630946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.631176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.638205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.638440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.686252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.687144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.734915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.735143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.737037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.737275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.893669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.893899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.894116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.894409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.894624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.894838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.894927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.895071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.895295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.895516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.895738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.895957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.919903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.920925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.932068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.933141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.945882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81677) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.946743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81678) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:29:21.964096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.964300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:29:21.964643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.964815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.964895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:29:21.965017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:29:21.965136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.965365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.965459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.965568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:29:21.965657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.965850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.965929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.966120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.966636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.966902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.975417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.975696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.975966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.976251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.976359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.976640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.976952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.977260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.984008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:21.985290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:21.986914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:21.987200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.987484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.987766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:21.988304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.988864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989710 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.989902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.990179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.990569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.990855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:21.991133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.012918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.014373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.014655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.015493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.017003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.017296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.019160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.019445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.019725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.021983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.022275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.022561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.026513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.026795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.029527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.029821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.030756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.031047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.031359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.031656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.031936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.033918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.034004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.034205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.034302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.034485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.034568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.034773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.035059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.035343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.035620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.035894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.051740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.052021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.054113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.054403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.055878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.059350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.060187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.060483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.062614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.062915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.064854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.067162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.067967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.070310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.071064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.071365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.071687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.071978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.072274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.072656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.074062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.074367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.074657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.074948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.075256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.075561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.088565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.088878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.089151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.089414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.092000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.092296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.092569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.092872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.096138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.097794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.099338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.099616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.099787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.101362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.102262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.102546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.102840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.103471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.103812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.104103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.104197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.106857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.107156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.107554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.107873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.108169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.115392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.115678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.115962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.116246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.116531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.116831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.117134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.120489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.120797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.121190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.121485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.121780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.122070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.122372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.133032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.136052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.138298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.138933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.140688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.141223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.142206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.142490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.142791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.144104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.145576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.147203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.147493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.148044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.150382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.151847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.154752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.155050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.155336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.155509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.155611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.157037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.160034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.160332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.160623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.160936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.163520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.163809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.164089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.169841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.170140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.170429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.171584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81677) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.171869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.172158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.172439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.172718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.173021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.173296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.173571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.173851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.174128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.174397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.174658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.174922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.175203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81677) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.177366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81678) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:29:22.177656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.177944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.178227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.178506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.178783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.179082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.179356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.179651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.179942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.180223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.180496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.180780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.181085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81678) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:29:22.209306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f1da59c0 pid: 81677 (default app) Aug 31 10:29:22.213355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f418-efa2-4348-9b0b-67c50d14a9d2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:22.213643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f418-efa2-4348-9b0b-67c50d14a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:22.213915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4f418-efa2-4348-9b0b-67c50d14a9d2 None None] PATH_INFO: `/v3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:22.217172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643f1da59c0 pid: 81678 (default app) Aug 31 10:29:22.218382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Wed Aug 31 10:29:22 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:28.822878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:28.823326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:28.823410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:28.827714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:28.832809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:28.833366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:28.833366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:28.906472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: INFO dbcounter [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] Registered counter for database keystone Aug 31 10:29:28.925621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG oslo_db.sqlalchemy.engines [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81677) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:29:28.932314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writer thread running {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:29:29.113859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG passlib.handlers.bcrypt [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81677) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:29:29.114250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG passlib.handlers.bcrypt [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81677) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:29:29.173942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:29.175531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:29.305218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:29:29.802958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:29.873303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: INFO dbcounter [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] Registered counter for database keystone Aug 31 10:29:29.894207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG oslo_db.sqlalchemy.engines [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81678) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:29:29.901236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writer thread running {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:29:30.022996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0310619-0328-459d-983d-0bbdaa23e3d2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:30.028070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:30.028716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:30.029021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:30.029296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:30.037352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:30.092595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:29:30.092972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6273d17-9423-4110-993a-53c1e106c3db admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:30.103030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 31 10:29:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:29:30.109003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:30.123570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5192-ae70-4e63-89c0-1e02b23f5f59 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:30.127988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:30.129116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:30.129399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:30.129672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] PATH_INFO: `/v3/projects/6872bf7790f84367af06df6d64db20b3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:30.131240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] RBAC: Authorizing `identity:get_project(project_id=6872bf7790f84367af06df6d64db20b3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:30.184873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:29:30.185218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ad1cd-762e-4a72-b61d-14f309cbe495 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:30.189760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Wed Aug 31 10:29:30 2022] GET /identity/v3/projects/6872bf7790f84367af06df6d64db20b3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:32.045956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738d7d-18b7-4cf6-9247-677efef18969 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:32.046536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738d7d-18b7-4cf6-9247-677efef18969 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:32.046536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738d7d-18b7-4cf6-9247-677efef18969 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:32.050611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:32.056522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:32.056967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:32.057056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:32.077493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:32.078984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:32.086676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:29:32.349353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738d7d-18b7-4cf6-9247-677efef18969 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:32.362288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738d7d-18b7-4cf6-9247-677efef18969 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:32.366484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:32.367080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:32.367360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:32.367633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:32.375986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:32.377782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2e88a-757d-4ce9-b5af-cfbcd725b945 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:32.386654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Aug 31 10:29:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:29:32.392025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:32.401719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84488bb3-9932-4705-94b3-6ec0068202ff None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:32.406026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:32.406652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:32.406933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:32.407208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:32.408510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:32.410371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80544c-14bf-4a39-86a3-5a27ecfda1fd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:32.411885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Wed Aug 31 10:29:32 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:34.381244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b400eb-578e-4ec3-800b-70961d812f83 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:34.381802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b400eb-578e-4ec3-800b-70961d812f83 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:34.381802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b400eb-578e-4ec3-800b-70961d812f83 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:34.383115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:34.389051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:34.389476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:34.389633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:34.408020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:34.409239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:34.412227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb0-98e2-4c3e-9706-4180ba40dabd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:34.412527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb0-98e2-4c3e-9706-4180ba40dabd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:34.412833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1aeb0-98e2-4c3e-9706-4180ba40dabd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:34.414176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:29:34.419468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:34.419801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:34.420078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:34.465221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG passlib.handlers.bcrypt [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81678) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:29:34.465608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG passlib.handlers.bcrypt [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81678) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:29:34.499535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:34.515582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:34.517224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:34.616393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:34.767775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:34.793029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:34.877453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648932-1635-4b67-8c9d-829fa4cf8943 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:34.881053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:34.911911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:34.912539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:34.912848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:34.913128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:34.924584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:34.934174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:34.935144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:34.935978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:34.942624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:34.982522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53efa3-45ff-4bf7-929a-4ed47fc0110f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:34.985104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.024889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.025582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.025863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.026134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.026475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.045961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ca66b-bc51-4e54-abbd-ea11accc69cd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.080933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.081646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.081971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.082248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.082912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:35.083215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.084607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.093546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.095079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.100548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:35.106519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:35.193746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:29:35.199930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:35.202686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.206720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a0c5-8ff2-4356-853e-d95afcf63e02 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.240828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.241462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.241740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.242009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.243697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.245188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.246910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:35 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:35.252211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:35.267106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.299551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03043f62-655f-42b6-813b-8ffc3aef599d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.333077 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.333924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.334199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.334467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.352973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.353875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317196-4879-42b2-b1d2-3516bc4009af None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.354444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:29:35.372943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:35.373870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:29:35.374895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:29:35.374895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:29:35.374895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:35.374895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:29:35.379751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:35.390332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.390964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.391247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.392199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.393365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.394818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.396369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:35.402851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:35.440940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.484214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:35.488333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdba4b-5902-461b-9b02-09e93408ec38 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.503265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04688-0549-4ac2-b310-66cbd852159f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:35.521500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.522105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.522640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.522915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.523560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:35.523862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.525905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63659ebb-9854-4cec-8fd1-6251169ca262 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.537405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:35.538031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:35.538309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:35.538578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:35.539299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.domain.id=default, user.id=fe1519f75f3640c8b90717953b8356e6) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:35.539660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:35.541100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa557bf-7d49-453b-b3f5-ae68ebaf2a14 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:35.542919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:35.547814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 31 10:29:35 2022] GET /identity/v3/role_assignments?user.id=fe1519f75f3640c8b90717953b8356e6&scope.domain.id=default&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:37.564565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146027e-8d59-41c6-9d68-646d3bfe8858 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:37.565489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146027e-8d59-41c6-9d68-646d3bfe8858 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:37.565918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146027e-8d59-41c6-9d68-646d3bfe8858 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:37.567408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:37.573010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1d39-b227-451b-a89d-5694837eb524 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:37.573808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1d39-b227-451b-a89d-5694837eb524 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:37.574247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d1d39-b227-451b-a89d-5694837eb524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:37.601808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d32d1d39-b227-451b-a89d-5694837eb524 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:37.603870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d32d1d39-b227-451b-a89d-5694837eb524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:37.695103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 12/23] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:38.034666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e3a6-b6ec-48e6-b272-2f3db760a0df None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.035345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e3a6-b6ec-48e6-b272-2f3db760a0df None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.035830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e3a6-b6ec-48e6-b272-2f3db760a0df None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.037415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:38.042695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.043231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.043709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.070188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081015bc-d199-427e-a235-553fa84c2823 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.071572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081015bc-d199-427e-a235-553fa84c2823 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.072122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081015bc-d199-427e-a235-553fa84c2823 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.073846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 13/25] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:38.075022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:38.076427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:38.085990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.086610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.087186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.127772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:38.130337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:38.236996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 14/26] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 10:29:38.238394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:38.250114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 13/27] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:38.313199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:38.378519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4fee-c683-40c2-8eff-685b2231a1cb None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:38.413634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:38.414271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.415082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.415353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.432153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-c3d42a58-5b78-4dfc-9458-fdcd5af3e681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:38.438706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:38.439722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:38.440504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:29:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:38.449909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:38.454749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:38.464784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b5b4-24f6-4b77-8dad-fd97aa946f61 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.465065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b5b4-24f6-4b77-8dad-fd97aa946f61 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.465332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b5b4-24f6-4b77-8dad-fd97aa946f61 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.467203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 16/29] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:38.472836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.473122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.473398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.499973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:38.501289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:38.613368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e73235-4083-4b7b-9cba-3cc4c3975fd5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:38.650383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:38.651031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:38.653589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:38.654270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.654556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.654829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.655501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:38.655804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:38.657239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:38.666400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 14/31] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:38.672110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:38.725113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:38.757175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:38.780657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197f7b7-199e-4f02-a89a-0712e737c4cd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:38.825151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:38.826094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.826518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.826936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.828828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:38.830562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:38.832318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 15/32] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:38 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:38.833253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:38.875432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44b03-aa51-4dc5-b50e-ff48d3acadb8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:38.946107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f703f-7c1a-4515-8428-4ce30fecf403 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:38.969482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:38.970162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.970450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.970730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.971603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:38.972835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:38.983528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:38.984398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:38.984896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:38.985312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:38.997778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:38.999605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.000572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:29:39.019149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:39.020252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:29:39.021183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:29:39.021183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:29:39.021183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:39.022928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 16/33] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:39.024201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:39.135960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969eee3-8d00-4d4c-acbc-90a63c98d219 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:39.143101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 18/34] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 31 10:29:38 2022] POST /identity/v3/roles => generated 219 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:39.144284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:39.176142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:39.177181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.177656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.178126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.180663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:39.182744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.184881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 17/35] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:39.190696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:39.261530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:39.295079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:39.307783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63207a6b-b381-4254-966a-7e0750bd6f68 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:39.318667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6145b-f816-49ac-a576-f9d787450383 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:39.363704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:39.364622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.365067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.365384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.366156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:39.368866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.375199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:39.376176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.376668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.377194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.378065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:39.378603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:39.380455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.397861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 19/36] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:39.397861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:39.510858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044fc2-51bb-4d4e-bdb9-b50eff8431c7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:39.518738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 31 10:29:39 2022] POST /identity/v3/roles => generated 225 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:39.520035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:39.554082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:39.554803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.555607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.555891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] PATH_INFO: `/v3/domains/default/users/fe1519f75f3640c8b90717953b8356e6/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.558635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fe1519f75f3640c8b90717953b8356e6, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:39.560139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18b9c4-fcc0-401c-baf5-9a945dfb5cf0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.579927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 20/38] 10.222.0.70 () {58 vars in 1361 bytes} [Wed Aug 31 10:29:39 2022] PUT /identity/v3/domains/default/users/fe1519f75f3640c8b90717953b8356e6/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:39.584784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a5b05-adfb-46c9-9c17-b4f00dcda353 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.584784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a5b05-adfb-46c9-9c17-b4f00dcda353 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.584784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a5b05-adfb-46c9-9c17-b4f00dcda353 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.584784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 21/39] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:39.589379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9f3a-fd0e-44bf-8911-5c96886f0663 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.589703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9f3a-fd0e-44bf-8911-5c96886f0663 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.590041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9f3a-fd0e-44bf-8911-5c96886f0663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.613372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-92dd9f3a-fd0e-44bf-8911-5c96886f0663 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:39.615040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-92dd9f3a-fd0e-44bf-8911-5c96886f0663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:39.636953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:39.675243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043b959-4ad3-410d-afa2-2707e83cce53 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:39.694049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:39.718164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 22/40] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:39.720411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72dd91-fc8c-455b-a8bd-546c30a3f433 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.720411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72dd91-fc8c-455b-a8bd-546c30a3f433 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.720411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72dd91-fc8c-455b-a8bd-546c30a3f433 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.725497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 23/41] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:39.729175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:39.730243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.730734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.731207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.731696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:39.732004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:39.732233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:39.733066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:39.734953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:39.753397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:39.755083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:39.784098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 19/42] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:29:39 2022] POST /identity/v3/projects => generated 301 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:39.854864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 24/43] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:40.023123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:40.134151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:40.221279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:40.246783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f8ee-7539-46bf-b8cc-fa75538a5c27 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:40.250236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254aa6-4393-4bc7-868f-b68224c8cbe9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:40.284093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:40.284650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:40.284946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:40.285220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:40.286310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:40.286851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:40.287469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:40.287756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:40.287843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:40.288035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:40.288715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:40.290038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 25/44] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:40.290945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0ccb0-bbe4-482f-92dd-12a9e7127750 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:40.295899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:40.310568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 20/45] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 31 10:29:40 2022] POST /identity/v3/roles => generated 223 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:40.408102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dda7a3-1d57-4f93-b0b3-d57cd1327e47 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:40.446578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:40.447204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:40.447489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:40.447768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:40.448441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:40.449922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c789-bb12-4b51-8014-363194572429 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:40.468736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:40.485909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 26/46] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:29:40 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:29:41.628367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ffab-199e-4a16-a865-9430ef124b52 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:41.628904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ffab-199e-4a16-a865-9430ef124b52 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:41.629015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2ffab-199e-4a16-a865-9430ef124b52 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:41.630310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 21/47] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:41.635875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:41.636290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:41.636575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:41.655517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:41.656710 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:41.721389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 27/48] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:41.990698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ffab-199e-4a16-a865-9430ef124b52 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.020359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:42.096909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2ffab-199e-4a16-a865-9430ef124b52 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.130589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.131219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.131501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.131777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.143105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:42.148245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:42.149951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:42.150734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 22/49] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:42.155875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.253160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326fdfa-e4c7-4fe7-86e4-d4b4419dce7f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.279593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:42.288264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.288912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.289221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.289496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.290266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:42.290572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:42.291959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b10b76-6530-46e8-b1f9-4758f4dc7dc4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:42.303622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 28/50] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:42.309342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.379378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb4bc-9928-4ade-8445-0dd3038db43a None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.379660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb4bc-9928-4ade-8445-0dd3038db43a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.379934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bb4bc-9928-4ade-8445-0dd3038db43a None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.381311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 29/51] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:29:42.386833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.387124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.387409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.393757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:42.406464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:42.407668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:42.409174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74dc6-9b13-4a0f-aa85-c78dfbe859a4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.442889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.443510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.443790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.444065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.445214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:42.447474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:42.449086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 23/52] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:42 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:42.454626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.479078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 30/53] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:42.554489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb72a5b-b33d-48d3-b2d3-dd75d951661c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.588100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.588726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.589036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.589309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.590421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:42.591983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:42.593570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 24/54] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:42.599342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.756813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:42.782137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:42.811104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1aaea-9856-4001-8224-8872c00cbbad None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.829262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:42.845940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.846554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.846834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.847111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.847832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.domain.id=default, user.id=fe1519f75f3640c8b90717953b8356e6) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:42.848142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:42.849611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:42.858309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 31/55] 10.222.0.70 () {56 vars in 1322 bytes} [Wed Aug 31 10:29:42 2022] GET /identity/v3/role_assignments?user.id=fe1519f75f3640c8b90717953b8356e6&scope.domain.id=default&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:42.864234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93de217-aec7-4661-a5ea-0792c1f8d99f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:42.902113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:42.902772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:42.903052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:42.903521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:42.904743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:42.906289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff1f21-50ce-4f71-9794-89ba51fe6a3e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:42.907951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 25/56] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:42.913802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:43.020295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b03f-0747-424c-b9e5-7de3ce675d63 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:43.059587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:43.060208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:43.060492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:43.060783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:43.061589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:43.063000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8772c-bf7c-4d61-93d6-1467ba0791a1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:43.088526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 32/57] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 31 10:29:42 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:44.985932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afef-8760-4a47-9327-de2b9595bc17 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:44.986438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afef-8760-4a47-9327-de2b9595bc17 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:44.986522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542afef-8760-4a47-9327-de2b9595bc17 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:44.987815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 26/58] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:44.993355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:44.993748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:44.993908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:45.012100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:45.013292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:45.038545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:45.081326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 33/59] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:45.362671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542afef-8760-4a47-9327-de2b9595bc17 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:45.453161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:45.463764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542afef-8760-4a47-9327-de2b9595bc17 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:45.496358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:45.496991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:45.497270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:45.497540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:45.498631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:45.500088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8d3c8-1632-4dcd-b62a-35efe6abbc89 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:45.501890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 27/60] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:45.507606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:45.605679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b66b3-795d-47ef-bfc2-47dba55850c7 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:45.637649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:45.638183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:45.638458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:45.638725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:45.639370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:45.640833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45041ebc-e34c-4c91-9946-465b352cd78c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:45.667614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 34/61] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:29:45 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:48.782705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c68bf7-fb3f-4fc1-a499-e12c10be3df2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.783729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c68bf7-fb3f-4fc1-a499-e12c10be3df2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.784230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c68bf7-fb3f-4fc1-a499-e12c10be3df2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.785861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 28/62] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:48.796703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f889d8-bd8f-427e-a4f4-470c9a4b4631 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.797601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f889d8-bd8f-427e-a4f4-470c9a4b4631 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.798090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f889d8-bd8f-427e-a4f4-470c9a4b4631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.823018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f8f889d8-bd8f-427e-a4f4-470c9a4b4631 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:48.824548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f8f889d8-bd8f-427e-a4f4-470c9a4b4631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:48.849902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:48.853665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43746a-7f40-4e3f-bcf1-6bb626da4b37 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.854227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43746a-7f40-4e3f-bcf1-6bb626da4b37 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.854695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43746a-7f40-4e3f-bcf1-6bb626da4b37 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.856521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 29/63] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:48.862885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405114d-b05c-4364-919e-fce7ec026941 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.863410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405114d-b05c-4364-919e-fce7ec026941 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.863877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405114d-b05c-4364-919e-fce7ec026941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.890254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d405114d-b05c-4364-919e-fce7ec026941 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:48.892746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d405114d-b05c-4364-919e-fce7ec026941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:48.944335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 35/64] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:48.945574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599d92-70e1-4b57-81b8-6384c8da98ff None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.946027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599d92-70e1-4b57-81b8-6384c8da98ff None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.946439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd599d92-70e1-4b57-81b8-6384c8da98ff None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.952142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 36/65] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:48.953620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e9ec-789d-41a7-a4f0-c746096691f5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:48.954048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e9ec-789d-41a7-a4f0-c746096691f5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:48.954558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050e9ec-789d-41a7-a4f0-c746096691f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:48.973942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c050e9ec-789d-41a7-a4f0-c746096691f5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:48.975578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c050e9ec-789d-41a7-a4f0-c746096691f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:48.975797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 30/66] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:49.092470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 37/67] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:49.195033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8be1e-97bf-4ac9-89a6-71df9c7b4ff6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.196210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8be1e-97bf-4ac9-89a6-71df9c7b4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.196629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8be1e-97bf-4ac9-89a6-71df9c7b4ff6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.198430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 31/68] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:49.210142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae60b4-a64b-451e-bbca-4c86e4bd2b8d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.210430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae60b4-a64b-451e-bbca-4c86e4bd2b8d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.210744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae60b4-a64b-451e-bbca-4c86e4bd2b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.237016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-aaae60b4-a64b-451e-bbca-4c86e4bd2b8d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:49.238215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-aaae60b4-a64b-451e-bbca-4c86e4bd2b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:49.267235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8be1e-97bf-4ac9-89a6-71df9c7b4ff6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.334240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 38/69] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:49.336556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e300-1240-4dcb-b09c-7081060af251 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.337030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e300-1240-4dcb-b09c-7081060af251 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.337472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5e300-1240-4dcb-b09c-7081060af251 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.343471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 39/70] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:49.344586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.344892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.345173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.363769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:49.364980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:49.368483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.397456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8be1e-97bf-4ac9-89a6-71df9c7b4ff6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.401344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.435956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.436974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.437619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.438227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.439322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 40/71] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:49.440502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.468918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:49.474650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:49.475676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:49.476489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:49.478587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 32/72] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:49.479513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.552983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dabd39-562b-44ff-aa16-c742873954e8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.589848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.590752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.591177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.591583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.597333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43e1f-3070-47a1-a0f6-ae9c86ec7bc9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.601856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.605018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:49.612170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:49.613237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:49.614211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:49.616278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 41/73] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:49.618214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.642533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.643253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.643600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.643941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.654421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:49.659705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:49.660562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:49.661380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 33/74] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:49.666791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.677384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.739717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86dc8f-03c2-4be8-9a39-e4436cca3a4c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.774081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.774451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96608774-c983-453f-96d1-8c68e4de00a8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.774686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.774965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.775239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.775904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:49.776210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:49.777652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:49.785477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 42/75] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:49.786272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.813495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.814108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.814389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.814668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.815338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:49.815642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:49.817066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:49.825626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 34/76] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:49.830265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.857922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.895874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580e923-7d10-4667-9ad9-10b02dcef07b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.897371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:49.930731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.930980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f265a32-88ae-428a-b201-edd4c937b7c2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:49.931372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.931655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.931933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.933109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:49.934606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:49.936189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 43/77] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:49.936988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:49.968527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:49.969158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:49.969435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:49.969707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:49.970364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:49.970669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:49.972053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:49.981591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 35/78] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:49.985653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.042108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bcf7b-e9bd-44cf-8fe1-7b6a6d0b5819 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.069284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.077605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.078234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.078517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.078788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.084569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9986-2c80-4d0e-9dab-4ca77d7c9cb1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.089524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:50.094828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:50.095774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:50.096540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 44/79] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:50.097259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.120487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.126270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.126903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.127187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.127467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.142547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.144052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.145715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 36/80] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:49 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:50.151345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.198191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48506b26-5dd3-476a-b3ca-2d8d4ae12979 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.232656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.233316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.233604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.233879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.235010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.236456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.238099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 45/81] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:50.243650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.246932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a9f72-ec2b-4450-bef9-b11523bed574 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.281238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.281835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.282112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.282387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.283037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.284530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.300124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.314498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 37/82] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:29:50 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:50.315436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.351023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31222-9dc0-40a3-9f4b-69dc7a37a110 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.378581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.394171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.394829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.395157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.395378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.397169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.399620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.401305 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 46/83] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:50.402005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.453422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3418a-0b5e-4494-8d83-d5e360546617 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.492724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.493427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.493715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.493996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.494687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:50.495423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.496556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.506688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 38/84] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:50.508379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.525353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7053-77fc-4851-949c-3f333efd53df None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.554873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.565995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.566642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.566892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.567163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.645262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898893-0d15-42d1-b3c9-986b9e3c8f09 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.655742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.656247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.658552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.693152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.693766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.694044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.694319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:50.768838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:50.770322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:50.770788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 47/85] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:29:50.771312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.808602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.888571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe2025-3e94-4555-b729-3bf55025edbf None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:50.889232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 39/86] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:29:50.893984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:50.901583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:50.935236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:50.936220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:50.936676 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:50.937125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.009485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c24a2b-d2d1-4c16-9749-06e7b1746827 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.016090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.017595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.047206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.052317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.053081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.053371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.053645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.054993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.056513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.062654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 40/87] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.062654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.141817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 48/88] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:29:51.143083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.152545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.187283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4905d-2adf-426c-8817-c5339da9c62e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.232567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.233609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.234108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.234592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.236188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.238726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.240988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 41/89] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.247007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.285326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fba874-a97a-4f5a-a86b-f38cd811dd40 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.314374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.326237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.327185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.327670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.328141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.329649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.331395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.333298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 49/90] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.340032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.362363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f94620-08ee-4f14-b620-c266368cfcc5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.400692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.401606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.401739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.402039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.418300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.456500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7949029-c557-4a14-8dbb-c3ea965d58f2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.485143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.486604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.497292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.498304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.498809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.499352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.500795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.502609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.504540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 50/91] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.511446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.584097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.602135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 42/92] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:29:51.602135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.636993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253732-75a3-474b-94b9-51a2c116d486 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.648817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.689238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.690482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.690966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.691681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.693117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=981d055b44f141968d64b673f5201015, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:51.693883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.696853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.704497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 51/93] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b24f159614534214a245691482a99191 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.709009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.726628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb759cd-5945-45c3-b212-1c2eb3c23fbb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.791274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:51.792292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:51.792827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:51.793305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:51.794422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981d055b44f141968d64b673f5201015, user.id=fe1519f75f3640c8b90717953b8356e6) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:51.794955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:51.796637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:51.807737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 43/94] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/role_assignments?user.id=fe1519f75f3640c8b90717953b8356e6&scope.project.id=981d055b44f141968d64b673f5201015&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:51.813459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:51.937645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66396c-a25e-4444-b9b5-f28924f1c836 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:51.988840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:51.993159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fdac8-7b4e-44d0-a4f0-c605e2ba8e67 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:52.009702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:52.011504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.013273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.013781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.014723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=981d055b44f141968d64b673f5201015, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:52.015284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:52.016588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:52.019544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:52.031023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 52/95] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:52.066596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:52.067680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.068182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.068675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] PATH_INFO: `/v3/projects/95536c312ed24808b7e8f1cca088da36` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.070506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=95536c312ed24808b7e8f1cca088da36)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:52.072253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df304cf-c085-47c9-94cc-738a6dd32aa4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:52.074223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 44/96] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:51 2022] GET /identity/v3/projects/95536c312ed24808b7e8f1cca088da36 => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:52.080282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:52.215693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031a194-2265-4e21-8d73-02434b14ab4a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:52.269694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:52.270665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.271146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.271613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.273474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=95536c312ed24808b7e8f1cca088da36, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:52.274012 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:52.275674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777e991-9cc9-4c56-b181-f338baab55c6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:52.282097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 53/97] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:29:52 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=95536c312ed24808b7e8f1cca088da36&role.id=b24f159614534214a245691482a99191 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:52.614454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be502-e2cd-4fae-bfb9-a439edbb13eb None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.615122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be502-e2cd-4fae-bfb9-a439edbb13eb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.615631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76be502-e2cd-4fae-bfb9-a439edbb13eb None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.617763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 45/98] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:52.622996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.623527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.624024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.648743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:52.650410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:52.685635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ebb9-da89-4d05-a98d-8cc3cf317ee4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.685934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ebb9-da89-4d05-a98d-8cc3cf317ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.686183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919ebb9-da89-4d05-a98d-8cc3cf317ee4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.687737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 46/99] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:52.692833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:52.693121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:52.693413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:52.712938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:52.714137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:52.728008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:52.760428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 54/100] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:52.814082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 47/101] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:53.258046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:53.337782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:53.398069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6b66b-2734-469a-b963-1ce01654c6c8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:53.483758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b38d2-ce73-4a86-b985-4b285cca41c5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:53.493110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:53.496678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:53.497349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:53.497627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:53.497898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:53.521409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:53.522728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:53.523585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:53.523933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:53.524276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:53.525488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:53.527019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:53.528728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 48/102] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:53.530873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:53.531729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:53.532514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 55/103] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:53.536011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:53.552054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:53.657238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:53.668989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00b7f-939a-45df-9ccc-277df1eafa2d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:53.744365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab6c18-50eb-4444-8788-79f4fa29abca None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:53.760291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:53.761336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:53.761851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:53.762323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:53.763192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:53.764903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:53.781414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:53.781943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:53.782227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:53.782962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:53.783641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:53.783949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:53.785404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:53.800984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 56/104] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:53.814458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:53.834197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 49/105] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:29:53 2022] POST /identity/v3/projects => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:53.956934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aca9bb-1af0-4861-9913-da100dbfa6b9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:53.965965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:53.995031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:53.995719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:53.996009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:53.996287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] PATH_INFO: `/v3/users/d16278dc3d1243d2a25f658f51e65232` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.013677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] RBAC: Authorizing `identity:get_user(user_id=d16278dc3d1243d2a25f658f51e65232)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:54.015179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:54.016972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 57/106] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:53 2022] GET /identity/v3/users/d16278dc3d1243d2a25f658f51e65232 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:54.023580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:54.060067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:54.162518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a614b-b1f0-4fa3-ac8e-07d5e8dba81a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:54.212142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:54.212789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.213081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.213360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.306190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:54.307695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6102db2-0cbe-4179-b94c-2a0b334f7ec0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:54.340484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:54.431305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 50/107] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:29:54.436654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:54.541050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50784-bccc-456a-a7a7-28cde9746640 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.541361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50784-bccc-456a-a7a7-28cde9746640 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.541611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50784-bccc-456a-a7a7-28cde9746640 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.542975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 51/108] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:54.549244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3ca3-4a4d-4ea7-a0e0-d03d144f029c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.549523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3ca3-4a4d-4ea7-a0e0-d03d144f029c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.549798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d3ca3-4a4d-4ea7-a0e0-d03d144f029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.577560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5e1d3ca3-4a4d-4ea7-a0e0-d03d144f029c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:54.578778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5e1d3ca3-4a4d-4ea7-a0e0-d03d144f029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:54.599962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eaace-1a81-40d8-8fcb-ab33b6aa615f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:54.664642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:54.665365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.665655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.665931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.668534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:54.670032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:54.671689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 58/109] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:54 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:54.677569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:54.713736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 52/110] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:29:54.733141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:54.842031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b0d2b-5534-4f2f-9624-835783fa7a97 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:54.894566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:54.895075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.895423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.895917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.897169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, scope.project.id=981d055b44f141968d64b673f5201015, user.id=d16278dc3d1243d2a25f658f51e65232) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:54.897482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:54.899668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1dfb6-982d-45da-b1ad-bc1ea06b4702 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:54.915828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 59/111] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:29:54 2022] GET /identity/v3/role_assignments?user.id=d16278dc3d1243d2a25f658f51e65232&scope.project.id=981d055b44f141968d64b673f5201015&role.id=281c6762dde74c799ee78cea7a9f015c => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:54.982231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ad678-77cc-4472-b230-77b84139ff84 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.982580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ad678-77cc-4472-b230-77b84139ff84 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.982814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ad678-77cc-4472-b230-77b84139ff84 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:54.984179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 53/112] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:54.989991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4427ce-e912-495a-a48f-34337c22a488 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:54.990278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4427ce-e912-495a-a48f-34337c22a488 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:54.990551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4427ce-e912-495a-a48f-34337c22a488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.017973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cc4427ce-e912-495a-a48f-34337c22a488 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:55.019182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cc4427ce-e912-495a-a48f-34337c22a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:55.106801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 60/113] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:55.236695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f0f4-af69-41a5-bd33-61e55ac5bce4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.237028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f0f4-af69-41a5-bd33-61e55ac5bce4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.237211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f0f4-af69-41a5-bd33-61e55ac5bce4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.238862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 54/114] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:55.244640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260fd05-86e6-43df-9e0d-1b804601b0b9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.244957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260fd05-86e6-43df-9e0d-1b804601b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.245231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260fd05-86e6-43df-9e0d-1b804601b0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.249878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f0f4-af69-41a5-bd33-61e55ac5bce4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:55.268482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1260fd05-86e6-43df-9e0d-1b804601b0b9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:55.269531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1260fd05-86e6-43df-9e0d-1b804601b0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:55.309362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:55.330839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:55.400496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 61/115] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:55.407047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e304d0-f00a-4f77-aa34-c47f707971ff None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.407333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e304d0-f00a-4f77-aa34-c47f707971ff None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.407610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e304d0-f00a-4f77-aa34-c47f707971ff None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.409085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 62/116] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:55.415703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.415987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.416266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.433154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f0f4-af69-41a5-bd33-61e55ac5bce4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:55.457582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:55.461652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:55.502672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:55.503231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.503513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.503790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.524543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:55.532272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:55.533121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:55.533886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:55.534927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 55/117] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:29:55.540328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:55.598142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 63/118] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:55.599030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:55.712518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f33de-6124-4a29-936e-a5c17251f58b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:55.759413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:55.761116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:55.789615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78835f6a-21ce-45dd-a83c-b620da801e03 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:55.813100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:55.814091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.814562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.815027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.836725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:55.841985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:55.842811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:29:55.843570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:55.849294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 56/119] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:55.852169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:55.871860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:55.872889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:55.873360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:55.873821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:55.874679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:55.875169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:55.876789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:55.887014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 64/120] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:55.888178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.009937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa07366-6383-45ca-9148-1f92fd283bf5 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.045909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e897a2e-9c49-4cfa-813f-0936fa487dcf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.046556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.047481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.047951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.048464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.049359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:56.049886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.051449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.061019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 65/121] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.062280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.077829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.085806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.086457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.086741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.087017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.098633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:56.104167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:56.105098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:56.105859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 57/122] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:56.106487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.152625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.181285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0310e4-7268-451f-b93a-c7714802e236 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.218152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.219226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.219701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.220204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.221787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.223457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.225477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 66/123] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.226481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.228072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931933-3f8d-49f8-82cb-63166546ad7f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.280505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.281250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.281660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.281951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.297302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:56.305269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:56.306156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:29:56.306921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:29:56.307510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 58/124] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:56.308537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.319857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.343889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bec82-c9ba-4407-a2dc-f92664d46ce4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.382527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.383550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.384095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.384579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.385950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.387602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.389761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 67/125] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.390813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.448898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.458576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5379c1-83c2-4844-adc9-4075a228e29e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.500625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d81c8f-9484-442f-a232-5e940bd1db63 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.507591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.508494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.508788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.509067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.509732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:56.510036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.511957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.524017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 59/126] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.525492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.543767 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.544330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.544871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.545155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.546749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.548489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.551200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 68/127] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.551979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.573914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.649061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c4859-6866-4156-be42-761efd9f8152 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.684815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578701c2-44b5-48b8-b08c-d5b30c6d45fa None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.687565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.688639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.689151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.689787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.690509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:56.690836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.692232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.701009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 60/128] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.701618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.724904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.727070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.727893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.728256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.728527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.729791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.731271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.737126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 69/129] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.737126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.816899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878c918-3f29-402f-a5d4-049ca199ffd1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.825408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:56.845369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7d06-2c3d-4f5a-9f8e-93d957237507 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:56.856358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.857026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.857310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.857588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.858728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.860202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1447c9-4d99-457d-90d8-87d82e187ecd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.866101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 61/130] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:56.866101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85521b-b599-4dea-a366-937cde385b9f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.866101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85521b-b599-4dea-a366-937cde385b9f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.866101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85521b-b599-4dea-a366-937cde385b9f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.866101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 62/131] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:56.870337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85521b-b599-4dea-a366-937cde385b9f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.887706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:56.887706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:56.887706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:56.887706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/users/7054692c5f5d4267963f967598c9045d/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:56.889527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, user_id=7054692c5f5d4267963f967598c9045d, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:56.890971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:56.905870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 70/132] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:29:56 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/users/7054692c5f5d4267963f967598c9045d/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:56.906668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:56.996315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.015930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85521b-b599-4dea-a366-937cde385b9f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.051927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7645f-c595-4517-a6d5-c7c5266b5f87 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.063356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.063924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.064204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.064511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.066087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.068599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.070567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 63/133] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:56 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:57.071792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.104052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.104718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.105044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.105324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/users/fe1519f75f3640c8b90717953b8356e6/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.107221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, user_id=fe1519f75f3640c8b90717953b8356e6, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.108672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a6f3e-47da-452d-a101-6adeb043ee84 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.131734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 71/134] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:29:56 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/users/fe1519f75f3640c8b90717953b8356e6/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:57.131734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.131734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.131734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.138225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.151353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:57.152669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:57.251752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 72/135] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:57.252732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.256366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c247c-16cd-48f7-a8f7-a0d9ebc86059 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.303480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.304253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.304534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.304922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] PATH_INFO: `/v3/projects/95536c312ed24808b7e8f1cca088da36` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.308164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] RBAC: Authorizing `identity:get_project(project_id=95536c312ed24808b7e8f1cca088da36)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.309772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68975591-60ba-4cb7-8015-af9c677b5e46 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.311514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 64/136] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:57 2022] GET /identity/v3/projects/95536c312ed24808b7e8f1cca088da36 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:57.312842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a6d2-adc9-4ae7-af1a-d949b73cb2e2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.313126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a6d2-adc9-4ae7-af1a-d949b73cb2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.313453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6a6d2-adc9-4ae7-af1a-d949b73cb2e2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.314831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 65/137] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:57.325848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6a6d2-adc9-4ae7-af1a-d949b73cb2e2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.364272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.377604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc853d-9f25-4c1e-af03-18ca08dd469c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.415788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.422990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.423944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.424228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.424502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.426531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.427969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879751-7450-49a4-96f1-91888a092354 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.430590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 73/138] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:57 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:57.431830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.432113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.432396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.457605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:57.458932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:57.467708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6a6d2-adc9-4ae7-af1a-d949b73cb2e2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.540558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 74/139] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:57.541456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.573581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.574192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.574473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.574752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] PATH_INFO: `/v3/projects/95536c312ed24808b7e8f1cca088da36/users/7054692c5f5d4267963f967598c9045d/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.577505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] RBAC: Authorizing `identity:create_grant(project_id=95536c312ed24808b7e8f1cca088da36, user_id=7054692c5f5d4267963f967598c9045d, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.578962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.627117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 66/140] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:29:57 2022] PUT /identity/v3/projects/95536c312ed24808b7e8f1cca088da36/users/7054692c5f5d4267963f967598c9045d/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:57.646387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.655096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e4ac-7219-43a6-b7b9-0fb18f01d75a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.689376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.701865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.702886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.703171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.703439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/users/7054692c5f5d4267963f967598c9045d/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.707057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, user_id=7054692c5f5d4267963f967598c9045d, role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.708643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.742661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 75/141] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:29:57 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/users/7054692c5f5d4267963f967598c9045d/roles/b5722621e10c4e1694a7eebeec0084eb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:57.802668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:57.815910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c2e48-f085-48b4-86be-90a5e4545391 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:57.855700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:57.856362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:57.856646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:57.856949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:57.858152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:57.859639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:57.861736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 67/142] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:29:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:57.863992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.869727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:57.985797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0c585-71cb-40c3-b9ca-6c2d3436b9a4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.026344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.027129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.027513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.027877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.032348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20fe38-468b-4819-b39b-a64679a99ce2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.041567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:29:58.047002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:29:58.047897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:29:58.048651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 76/143] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:29:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:29:58.055103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:58.093087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.093775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.094063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.094342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.095008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:58.096467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:58.110349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:58.141945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 68/144] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:29:57 2022] POST /identity/v3/users => generated 283 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:29:58.168156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f429b36-63f4-4d35-b11f-8879d31eb1ae None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.209448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.210644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.210926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.211200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.211876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:29:58.212176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:58.213599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:58.223126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 77/145] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:29:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:29:58.228926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:58.243955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:58.358140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183134-5593-4d4b-bd4b-1919cdf315b0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.406821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.407401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.407689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.407963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] PATH_INFO: `/v3/users/d16278dc3d1243d2a25f658f51e65232` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.410461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] RBAC: Authorizing `identity:get_user(user_id=d16278dc3d1243d2a25f658f51e65232)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:58.412031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:58.414366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 69/146] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:29:58 2022] GET /identity/v3/users/d16278dc3d1243d2a25f658f51e65232 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:58.420448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:58.527905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9943a0-61b4-4790-be90-631f10754f2b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.549144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:58.563972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.564607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.564918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.565193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.566381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:58.567940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0b18-6d39-4628-8ce1-6a1f9e9cb3fe None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:58.570372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 78/147] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:29:58 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:29:58.576812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:29:58.675888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:58.703924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97931b-09b8-48b9-8cb7-50c7f97cabec None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:29:58.740545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:29:58.741298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:58.741753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:58.742035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/users/d16278dc3d1243d2a25f658f51e65232/roles/281c6762dde74c799ee78cea7a9f015c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:58.744095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, user_id=d16278dc3d1243d2a25f658f51e65232, role_id=281c6762dde74c799ee78cea7a9f015c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:29:58.745685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91e053-2fed-415f-85cf-b45b3921fa1c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:29:58.766141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 70/148] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:29:58 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/users/d16278dc3d1243d2a25f658f51e65232/roles/281c6762dde74c799ee78cea7a9f015c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:29:59.489700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7889-577e-48be-b8dd-0f5d5aad717e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:59.490062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7889-577e-48be-b8dd-0f5d5aad717e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:59.490235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb7889-577e-48be-b8dd-0f5d5aad717e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:59.492483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 79/149] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:59.498574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad865-1a80-4826-b7a6-cedae069dee1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:59.498862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad865-1a80-4826-b7a6-cedae069dee1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:59.499136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dad865-1a80-4826-b7a6-cedae069dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:59.522481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-38dad865-1a80-4826-b7a6-cedae069dee1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:59.524472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-38dad865-1a80-4826-b7a6-cedae069dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:59.614250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 71/150] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:29:59.715092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ec4-0588-4130-86ae-a3de7bb1afa4 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:59.715725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ec4-0588-4130-86ae-a3de7bb1afa4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:59.715725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9758ec4-0588-4130-86ae-a3de7bb1afa4 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:59.716990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 80/151] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:29:59.722229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:29:59.722512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:29:59.722785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:29:59.749850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:29:59.750981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:29:59.843099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:29:59.855029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 72/152] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:00.090760 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9758ec4-0588-4130-86ae-a3de7bb1afa4 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.211062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9758ec4-0588-4130-86ae-a3de7bb1afa4 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.245720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.246349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.246619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.246884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:00.258162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:00.263446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:00.264494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:00.265392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 81/153] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:00.272328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.329191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.413844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:00.458837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf82ef-8475-40e0-b5d8-7410da9b1c64 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.531124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.531745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.532020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.532287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:00.536371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1889a-c6d5-492e-8a73-53597a7fe842 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.537825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:00.538286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:00.539747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:00.560633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 73/154] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:00.579101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.582190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.582820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.583094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.583420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:00.595146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:00.600878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:00.601990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:00.603009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 82/155] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:00.609830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.672874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:00.725983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4383f-91da-4049-ad8c-95549b6e261a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.768576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.769242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.769639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.769931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:00.771222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:00.773401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:00.776367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 74/156] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:00.782700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.821118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1258d-2c00-4573-8d80-3eb86057a8e9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.825121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:00.874952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.875576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.875856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.876130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:00.876822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:00.877152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:00.878545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:00.892302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 83/157] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:00.898256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:00.903564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c103-9103-4f89-8f57-53b91de0ff92 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:00.931763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:00.945557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:00.946166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:00.946432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:00.946703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.080574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:01.082450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff20a-fb70-4bdc-b3b3-6757f2d7097d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:01.087333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893b2c3-2584-431c-ad91-82d782032045 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:01.154344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:01.154977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.155254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.155528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] PATH_INFO: `/v3/users/fe1519f75f3640c8b90717953b8356e6` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.158438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] RBAC: Authorizing `identity:get_user(user_id=fe1519f75f3640c8b90717953b8356e6)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:01.160455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065e49c-6ec2-4097-a24e-9125133f93eb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:01.162237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 84/158] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/users/fe1519f75f3640c8b90717953b8356e6 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:01.164345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa2d6-fbe6-4cc0-b524-6656cbeb0891 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.164692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa2d6-fbe6-4cc0-b524-6656cbeb0891 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.165034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5fa2d6-fbe6-4cc0-b524-6656cbeb0891 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.167283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 85/159] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:01.174163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fa2d6-fbe6-4cc0-b524-6656cbeb0891 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:01.250616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:01.296928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 75/160] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:30:01.300405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.305321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.305617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.335397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:01.336631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:01.372432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:01.421167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5fa2d6-fbe6-4cc0-b524-6656cbeb0891 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:01.468493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 76/161] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:01.469731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:01.488541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:01.489191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.489476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.489750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.644731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267bdc-71f0-4466-ba4c-81dfcc0a66bb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:01.666771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:01.668257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd50c-62d4-4255-8f53-d164f8d7a035 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:01.704307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:01.705602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.706016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.706419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.708800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:01.710576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcbc08-8599-4dc6-a459-e4f16633da57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:01.713460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 77/162] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:01 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:01.718951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430f9f-b9de-43e4-bec8-9493097675f6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.719375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430f9f-b9de-43e4-bec8-9493097675f6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.719852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26430f9f-b9de-43e4-bec8-9493097675f6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.721409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 78/163] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:01.723052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430f9f-b9de-43e4-bec8-9493097675f6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:01.743336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:01.766123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:01.893610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26430f9f-b9de-43e4-bec8-9493097675f6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:01.936268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 86/164] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:01.938322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.938800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.939311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.939428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:01.939943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:01.940231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:01.940506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:01.944316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=981d055b44f141968d64b673f5201015, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:01.944316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:01.944316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:01.950809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 79/165] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:01 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b24f159614534214a245691482a99191 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:01.951736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:01.972415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:01.974077 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:02.085614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 87/166] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:02.087015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.107338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:02.121431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e588f6-4661-4614-bbfa-ce3253831358 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.177172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:02.186207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.186851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.187079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.187356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.206819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:02.217574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:02.218567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:02.219656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 80/167] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:02.227398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.229833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb4ee3-be2a-478f-a24f-e44d4b00b11f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.274803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.275997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.276476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.277006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.279704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:02.281793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:02.284114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 88/168] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:02.308372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.359254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1d7a-5bc3-42c3-b1ce-d5eda5f27327 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.398543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.399295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.399577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.399856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.400535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:02.400872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:02.402543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:02.411741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 81/169] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:02.418126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.437303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:02.447531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856ee1-7e10-4336-8ca3-ba33bb9812b3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.481189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:02.486683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.487765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.488247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.488861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.489953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981d055b44f141968d64b673f5201015, user.id=fe1519f75f3640c8b90717953b8356e6) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:02.490457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:02.492309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:02.499193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 89/170] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/role_assignments?user.id=fe1519f75f3640c8b90717953b8356e6&scope.project.id=981d055b44f141968d64b673f5201015&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:02.555953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d68a-3741-4436-b9f0-652b1622f63c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.593513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.594163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.594443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.594718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.595898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:02.597407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:02.599333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 82/171] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:02.605284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.747721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c860f-4617-4bac-88ac-1b6b9089bf7f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:02.787560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:02.788475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:02.788923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:02.789331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:02.853267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:02.863486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:02.865184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:02.949280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:02.973351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 90/172] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:02.980104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:03.117561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.124397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271a4e4-612d-49d8-aa23-017c90b40bfb None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:03.145656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.173258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:03.174203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.174624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.175047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.181690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:03.183919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:03.189965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 91/173] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:03.195903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:03.210935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d3791-5d0e-49b2-bc1c-1752ff81b057 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:03.318150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382769-a5fb-44ab-a4e6-0f487d18095c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:03.336072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:03.336881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.337163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.337431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.365873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:03.368010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.368499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.368646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:03.368864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.370392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=981d055b44f141968d64b673f5201015, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:03.370710 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:03.372173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c16bb-dcba-4e6e-b0a2-c9acd801ad43 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:03.379194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 92/174] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:03 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4f66b959-cb14-430a-9e90-ca22acbba930 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:03.388916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:03.389892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 83/175] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:03.390692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf4ae-6b72-437d-aa59-fa9de88fbf82 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.391433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf4ae-6b72-437d-aa59-fa9de88fbf82 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.391505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6bf4-d8b8-4e03-a068-55584421a472 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.391575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf4ae-6b72-437d-aa59-fa9de88fbf82 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.391645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6bf4-d8b8-4e03-a068-55584421a472 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.391645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6bf4-d8b8-4e03-a068-55584421a472 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.391645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 93/176] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:03.394365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 84/177] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:03.401816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fb88-3a95-40aa-ba20-3f071a64f510 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.402109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fb88-3a95-40aa-ba20-3f071a64f510 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.402373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17fb88-3a95-40aa-ba20-3f071a64f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.406219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.406803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.407284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.432514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:03.434229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:03.445674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fc17fb88-3a95-40aa-ba20-3f071a64f510 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:03.446900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fc17fb88-3a95-40aa-ba20-3f071a64f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:03.509150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.533965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 85/178] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:03.540798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:03.628920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.655100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 94/179] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:03.655100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa34c-3fcd-4082-8dee-480035f86200 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.655100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa34c-3fcd-4082-8dee-480035f86200 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.655100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aa34c-3fcd-4082-8dee-480035f86200 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.657117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 95/180] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:03.664349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7622a-8c78-4382-b174-b2678e8ccf5f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.665268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7622a-8c78-4382-b174-b2678e8ccf5f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.665268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7622a-8c78-4382-b174-b2678e8ccf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.684561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dafab3-ed19-48ed-a0cf-106879f58de1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:03.690186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7aa7622a-8c78-4382-b174-b2678e8ccf5f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:03.691387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7aa7622a-8c78-4382-b174-b2678e8ccf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:03.738173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:03.738845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.739073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.740232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.740232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:03.740405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:03.742618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc4958-bf01-40e9-927a-61bddcbead11 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:03.756124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 86/181] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:03.763232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732d60-2888-429e-b222-4d2814c93eb5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.763403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732d60-2888-429e-b222-4d2814c93eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.763617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732d60-2888-429e-b222-4d2814c93eb5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.765514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 87/182] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:03.770233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732d60-2888-429e-b222-4d2814c93eb5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:03.792290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 96/183] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:03.793977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.794475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.794953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.832407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:03.833718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:03.942743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732d60-2888-429e-b222-4d2814c93eb5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:03.957038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 97/184] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:03.958591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:03.975486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.982364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:03.985894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:03.986546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:03.986816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:03.987088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] PATH_INFO: `/v3/users/7054692c5f5d4267963f967598c9045d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:03.989338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] RBAC: Authorizing `identity:get_user(user_id=7054692c5f5d4267963f967598c9045d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:03.990791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:03.992922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 88/185] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:03 2022] GET /identity/v3/users/7054692c5f5d4267963f967598c9045d => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:03.994373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.090681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ddf1-1766-42f0-a35b-c46465b16e67 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.133930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.134902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.135185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.135460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.141261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91acdd-cb80-4444-9b22-293d20ff7bbd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.155228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:04.162128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:04.163648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 98/186] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:04.165587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.186475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.187053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.187564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.188099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.201771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:04.208637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:04.213111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 89/187] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:04.214116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.248604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.275224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e606-27c6-4eef-a4dc-2af89e89993e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.277758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.308661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.309289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.309562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.309828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.320985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7f04-705d-451b-9285-4b37ddce2dd3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.354810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.355513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.355787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.356052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.366654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:04.372029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:04.373084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 90/188] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:04.377569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.378301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.378697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.452449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.473632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757127-c9af-4a22-86f8-5a84ae55c6ae None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.477644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 99/189] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:04.478467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.501587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.520915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.521771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.522042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.522359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.523194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:04.523495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.524934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.532796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 91/190] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.533568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.590664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969851-8c71-477f-8c09-3f630782d07c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.625973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.626573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.626850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.627121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.627769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:04.628067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.629471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.631206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f8db5-8203-46e8-9838-6b333f9ebebe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.637324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 100/191] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.638210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.665034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.665658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.665936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.666207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.667329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.668801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.670347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 92/192] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.671100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.674126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.720094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.745072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b8d5c-3d8f-4f6e-ab95-01e5d1cad781 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.778753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a34be-80d2-4a8f-9ff3-f763622bdf08 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.796222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.797142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.797829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.798119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.798797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:04.799105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.801131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.813566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 101/193] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.816109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.816742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.817052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.817327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] PATH_INFO: `/v3/projects/95536c312ed24808b7e8f1cca088da36` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.818685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=95536c312ed24808b7e8f1cca088da36)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.818858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.820663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.827336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 93/194] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/projects/95536c312ed24808b7e8f1cca088da36 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.828211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.927397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.930858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3bcc0-8d47-4c2a-ab58-c0238e3b7211 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.933872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af10b47-bba2-4fa5-94cf-65b09695fcd3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:04.950001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:04.969891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.970661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.970914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.971148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.971978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:04.972611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:04.972953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:04.973345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] PATH_INFO: `/v3/users/d16278dc3d1243d2a25f658f51e65232` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:04.975382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d16278dc3d1243d2a25f658f51e65232)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.977388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.978968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 94/195] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/users/d16278dc3d1243d2a25f658f51e65232 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.979707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:04.986640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:04.988774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:04.990842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 102/196] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:04.992822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.089409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8946-9a51-43f8-908c-04156b3f55f5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.097727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62694-896b-49d3-849f-aff2c27fc15f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.123012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.123616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.124067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.124179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.124905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.126283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.131057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.132322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.132607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.132908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.134024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.135459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.137283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 103/197] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:04 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:05.137820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.153330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 95/198] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:04 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:05.154209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.177395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.204470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.269181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928913b-f76d-4b55-a869-ae4800b37338 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.280055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c60c1-0859-4a63-b700-104273991f66 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.311143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.312845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.312845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.312845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.313109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=95536c312ed24808b7e8f1cca088da36, user.id=7054692c5f5d4267963f967598c9045d) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:05.313328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.314817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.317960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.318591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.318840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.319652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.329548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 104/199] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/role_assignments?user.id=7054692c5f5d4267963f967598c9045d&scope.project.id=95536c312ed24808b7e8f1cca088da36&role.id=b24f159614534214a245691482a99191 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:05.329548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.426589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.428102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.463430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.476822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d4e1-8b04-46aa-84e3-e5f928692e0a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.483557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.525512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.526051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.527134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.527134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.566038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 96/200] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:05.566916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.620253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.622176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.692734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75972597-58b5-4014-b24b-400f98b29ae2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.731817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.732496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.732793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.733071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.742089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.748400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:05.773163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 105/201] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:05.773163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.826716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.828452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.912486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711252-1557-4365-b25e-138adff6e811 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:05.941090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 97/202] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:05.942104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.958365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:05.959670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:05.960430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:05.960881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:05.962373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:05.964282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:05.967059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 106/203] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:05.968244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:05.988168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:06.030677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:06.050968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c356069-f742-4bbd-aa78-39dfd1149a59 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:06.080454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da4aa-8bfb-4344-a551-5ebe451015cc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:06.088453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:06.089740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:06.090431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:06.090431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:06.091592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:06.093481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:06.100115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 98/204] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:06.100115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:06.128705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549295-a8cc-4851-a576-29365920decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:06.129724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549295-a8cc-4851-a576-29365920decd None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:06.130233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549295-a8cc-4851-a576-29365920decd None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:06.130705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7549295-a8cc-4851-a576-29365920decd None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:06.132629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7549295-a8cc-4851-a576-29365920decd None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:06.134402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7549295-a8cc-4851-a576-29365920decd None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:06.136596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 107/205] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:05 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:06.137669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549295-a8cc-4851-a576-29365920decd None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:06.210491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b393-aeb8-4b9c-b3ab-e8168471cdaf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:06.219676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:06.245435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7549295-a8cc-4851-a576-29365920decd None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:06.246493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:06.247151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:06.247435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:06.247709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:06.248430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, scope.project.id=981d055b44f141968d64b673f5201015, user.id=d16278dc3d1243d2a25f658f51e65232) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:06.248737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:06.250260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:06.257434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 99/206] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:06 2022] GET /identity/v3/role_assignments?user.id=d16278dc3d1243d2a25f658f51e65232&scope.project.id=981d055b44f141968d64b673f5201015&role.id=281c6762dde74c799ee78cea7a9f015c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:06.258632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:06.277078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:06.289394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:06.290410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:06.290894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:06.291381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:06.292339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=3942de4e537145adb734b38271c9f8c5) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:06.299939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:06.301873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834fa8d-a03c-4314-b77a-9fb0c29ee621 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:06.317299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 108/207] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:06 2022] GET /identity/v3/role_assignments?user.id=3942de4e537145adb734b38271c9f8c5&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:06.380775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65d71-d51e-4187-b165-050aca3ba7fe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:06.426773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:06.427415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:06.427697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:06.427972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:06.429063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=3942de4e537145adb734b38271c9f8c5) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:06.429533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:06.431051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595403a-ea07-4d66-940c-d5bb8f93dbd4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:06.442010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 100/208] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:06 2022] GET /identity/v3/role_assignments?user.id=3942de4e537145adb734b38271c9f8c5&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:07.378744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656cd2-a17e-43a5-99c6-d8574b5b89cb None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:07.379297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656cd2-a17e-43a5-99c6-d8574b5b89cb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:07.379297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25656cd2-a17e-43a5-99c6-d8574b5b89cb None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:07.380815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 109/209] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:07.386941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0980a-9369-4d8a-a2b4-9827af836274 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:07.387782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0980a-9369-4d8a-a2b4-9827af836274 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:07.388286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0980a-9369-4d8a-a2b4-9827af836274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:07.408231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-caa0980a-9369-4d8a-a2b4-9827af836274 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:07.409456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-caa0980a-9369-4d8a-a2b4-9827af836274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:07.440293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:07.481756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 101/210] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:07.504475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338126f1-4469-4cb7-92d1-4b2805f0807e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:07.504796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338126f1-4469-4cb7-92d1-4b2805f0807e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:07.505056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338126f1-4469-4cb7-92d1-4b2805f0807e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:07.506507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 110/211] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:07.512814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:07.513426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:07.513900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:07.533838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:07.535403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:07.609537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 102/212] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:07.756449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338126f1-4469-4cb7-92d1-4b2805f0807e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:07.870919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338126f1-4469-4cb7-92d1-4b2805f0807e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:07.888527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:07.910208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:07.910846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:07.911123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:07.911393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:07.926772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:07.934063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:07.934989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:07.935801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 111/213] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:07.945865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:07.994103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:07.999951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936dcd8-7904-4a7a-9d06-604fb84fd0e2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.001934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:08.038181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.038818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.039095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.039367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.040591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.042763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.044954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 103/214] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:08.050149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:08.070700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e286-ff48-450e-a71f-37e1178f5496 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.118379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.119285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.119661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.120273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.121533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:08.121993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.123994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.136421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 112/215] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:08.141829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:08.168884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18fb3b-681b-4ee3-95ae-2d28dce2efa3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.209244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.210555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.210983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.211397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.212211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.213907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.239319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 104/216] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:08 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:08.252880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227f0e7-3168-4f78-85ea-1eee80692e19 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.267058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:08.295737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.296308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.296584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.296897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] PATH_INFO: `/v3/users/a10e551861c04001962265b2c03344f3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.313569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] RBAC: Authorizing `identity:get_user(user_id=a10e551861c04001962265b2c03344f3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.315145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56f090-abbb-40d7-9572-6e5ad41f87ab None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.317231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 113/217] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:08 2022] GET /identity/v3/users/a10e551861c04001962265b2c03344f3 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:08.323420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:08.348794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:08.423542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fac4-6561-4f8f-8bfc-a2a660e88a94 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.424038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fac4-6561-4f8f-8bfc-a2a660e88a94 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.424141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297fac4-6561-4f8f-8bfc-a2a660e88a94 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.425626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 114/218] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:30:08.434824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a545cf-ab8e-4648-9436-1e3a6d13c97d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.434824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a545cf-ab8e-4648-9436-1e3a6d13c97d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.434824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a545cf-ab8e-4648-9436-1e3a6d13c97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.442158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc76956-4c27-485a-9131-330d3a41bcb4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.457366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b7a545cf-ab8e-4648-9436-1e3a6d13c97d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:08.458588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b7a545cf-ab8e-4648-9436-1e3a6d13c97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:08.486178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.487104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.487400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.487679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.553944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 115/219] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:08.555160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee449-d8f3-47f6-acce-5bc5b49eb986 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.555441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee449-d8f3-47f6-acce-5bc5b49eb986 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.555708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ee449-d8f3-47f6-acce-5bc5b49eb986 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.557875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 116/220] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:08.567644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.567924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.568200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.582077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.583634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.588377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:08.589588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:08.609535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:08.676631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 117/221] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:08.709963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 105/222] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:08.716158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:08.751265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:08.845341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9755fb7-5515-45ec-af4e-230d5bbad3b0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:08.888422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:08.907253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:08.908188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:08.908644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:08.909142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:08.913808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:08.916484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:08.919588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 118/223] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:08 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:08.926872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.109138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:09.113487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc527a-a479-49e3-b557-e4a4f19e1080 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.137349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d827e28-7a36-4cfa-a562-cf5ca1a802cb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.170893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:09.179472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.180601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.181528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.182295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.183645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=a10e551861c04001962265b2c03344f3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:09.184556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:09.186595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:09.189760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.190515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.190950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.191420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.194015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 119/224] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:08 2022] GET /identity/v3/role_assignments?user.id=a10e551861c04001962265b2c03344f3&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b24f159614534214a245691482a99191 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:09.195116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.232315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:09.251251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:09.252228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:09.253733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 106/225] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:09.260011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.361365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90a27-72e6-42a1-8e87-9bc4e43a4529 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.415460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.416451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.417256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.417731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.434132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:09.440361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:09.441534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:09.442341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 120/226] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:09.456791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.498005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:09.617519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1347-cd04-4c6b-a6ae-bc94cbbab6c0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.656399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.657203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.657489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.657853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.658772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:09.659083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:09.660831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:09.669017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2a18-87a6-45f1-b6aa-44f74ae68534 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.671134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 121/227] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:09.678990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.807230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:09.823742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fbf0a-796a-474f-9505-39592dc9e41d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:09.833476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.834464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.835543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.836040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.836952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:09.837475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:09.839127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:09.861736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:09.862653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:09.862944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:09.863217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:09.864415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:09.865744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 107/228] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 606 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:09.872629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:09.873169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 122/229] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:09.874183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.874481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:09.974169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:09.996116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2c579-4258-4c64-a722-68e127379c0c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:10.039418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:10.040217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.040510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.040946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.042088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:10.044786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:10.045529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 123/230] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:10.051252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:10.083194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:10.107431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c907143d-df57-4525-a5e2-bc7a7f609303 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:10.189095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:10.189690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.189974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.190251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.191429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:10.192914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:10.195259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 108/231] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:09 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:10.201853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:10.238988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0825004-96c1-4f6d-a83d-1aa052fa5137 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:10.305215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:10.306984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.307264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.307540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/3942de4e537145adb734b38271c9f8c5/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.314628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, user_id=3942de4e537145adb734b38271c9f8c5, role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:10.316087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:10.339789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 124/232] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:10 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/3942de4e537145adb734b38271c9f8c5/roles/b5722621e10c4e1694a7eebeec0084eb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:10.416783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4566-cee5-42ad-b2ac-5ed778759d14 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:10.437146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:10.493715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:10.494326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.494641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.494919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.496220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:10.497733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ca677-e179-47d1-9749-c92a36acdb32 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:10.499615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 109/233] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:10 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:10.505478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:10.601706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:10.624863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80fe1d-d920-4dab-b447-9e4e83267df5 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:10.662270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:10.663552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.663948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.664226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/3942de4e537145adb734b38271c9f8c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.666233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, user_id=3942de4e537145adb734b38271c9f8c5, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:10.667686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25d705-e861-499d-ab0c-d57cfc3c7dba None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:10.688782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 125/234] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:10 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/3942de4e537145adb734b38271c9f8c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:10.837157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adad1-81d5-4914-80e7-fbcd44ed5525 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.838138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adad1-81d5-4914-80e7-fbcd44ed5525 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.838630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adad1-81d5-4914-80e7-fbcd44ed5525 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.840326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 110/235] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:10.846185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.846500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.846739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.881956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:10.883282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:10.934658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e991f5-39ae-4703-948e-5db239e89c07 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.935327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e991f5-39ae-4703-948e-5db239e89c07 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.935799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e991f5-39ae-4703-948e-5db239e89c07 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.937405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 111/236] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:10.942648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:10.942929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:10.943206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:10.969201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:10.970463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:10.976576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 126/237] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:11.056613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 112/238] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:11.479341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:11.492661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:11.601271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:11.638782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe029-2b8b-4ecc-ae62-bc09924b81aa None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:11.656365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0113e-22b8-4219-84fd-ff95a753da5d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:11.669453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:11.684944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:11.685571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:11.685842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:11.686106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:11.687732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:11.689501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25d8d0-21ed-4014-a4e3-897fe782a833 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:11.692216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 127/239] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:11.700781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e488a-ce87-4e6e-a841-a5c25acbe281 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:11.700781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e488a-ce87-4e6e-a841-a5c25acbe281 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:11.700781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e488a-ce87-4e6e-a841-a5c25acbe281 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:11.700781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 128/240] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:11.700781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e488a-ce87-4e6e-a841-a5c25acbe281 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:11.718125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:11.719017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:11.719759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:11.724778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:11.734722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-dcc388b2-e682-4e30-91de-dce9f8c2959f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:11.741946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:11.742939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:11.743742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 113/241] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:11.748979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:11.748979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:11.748979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:11.769210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:11.771453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:11.832283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e488a-ce87-4e6e-a841-a5c25acbe281 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:11.857226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 114/242] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:11.858708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:11.880254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:11.880888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:11.881212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:11.881486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:11.882123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:11.883623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:11.901245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:11.934572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 129/243] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:11 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:12.010013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:12.014337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1994e-54f4-4e1e-af30-8f0ac182079b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.097553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:12.098199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.098492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.098758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.099454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:12.099761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:12.101995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:12.121493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 115/244] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:12.127017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.197178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.270682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9e2ff-f218-4d65-9a2e-607cdc60e970 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.331721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:12.332327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.332603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.332923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] PATH_INFO: `/v3/users/387dd720f3af430d8f5e165672dd1595` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.342497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159d5f4-618e-4780-b9fb-09068c089ef3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.351233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] RBAC: Authorizing `identity:get_user(user_id=387dd720f3af430d8f5e165672dd1595)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:12.352082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:12.355671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 130/245] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/users/387dd720f3af430d8f5e165672dd1595 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:12.361719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.386819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:12.387803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.388284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.388908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.402605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:12.409813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:12.410761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:12.411582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:12.415623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 116/246] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:12.421732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.449151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:12.456560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:12.554346 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7fa6-1bc0-472d-8f0d-6722552cc1bb None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.564225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05763690-3377-4f8b-a65f-19cbecef095c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.602651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:12.603271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.603556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.603833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.604505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:12.604860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:12.607007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:12.619559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 117/247] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:12.626395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:12.626854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.626933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.626933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.626933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.745604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:12.747230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8292f50e-08d7-4f36-a9b0-63327da5ecf0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:12.806381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:12.867086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 131/248] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:12.868781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98611-fc72-4cd8-8791-9aad890bd053 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:12.869113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98611-fc72-4cd8-8791-9aad890bd053 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:12.869397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98611-fc72-4cd8-8791-9aad890bd053 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:12.870668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 132/249] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:12.875686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec98611-fc72-4cd8-8791-9aad890bd053 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:12.878388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:12.968787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f2cb8-77e9-4da2-9b99-0ec269aa61ff None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:12.996781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec98611-fc72-4cd8-8791-9aad890bd053 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:13.064980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:13.065545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.068816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.068816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] PATH_INFO: `/v3/users/a10e551861c04001962265b2c03344f3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.068816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=a10e551861c04001962265b2c03344f3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:13.069609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcd3b4-aaca-48b7-a019-1ff70e274fc4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:13.071919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 118/250] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/users/a10e551861c04001962265b2c03344f3 => generated 297 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:13.076172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:13.076172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.076172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.076172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.076491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:13.080780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:13.080909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.080909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.080909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.083712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 133/251] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:12 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:13.085175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:13.123908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:13.125335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:13.126851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:13.233289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 119/252] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:13.234155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:13.234589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215015dc-ebfb-4992-ac9f-846b18688b1c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:13.281208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:13.282035 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.282372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.282704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.283950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:13.285630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d6fad-7fda-4eb1-9b1d-45702dcbe913 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:13.288336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 134/253] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:13 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:13.290370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b1aa-6c78-42eb-8681-4e88855d8133 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.290370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b1aa-6c78-42eb-8681-4e88855d8133 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.290370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2b1aa-6c78-42eb-8681-4e88855d8133 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.296922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 135/254] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:13.298960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2b1aa-6c78-42eb-8681-4e88855d8133 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:13.355373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:13.375571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18758e-27ab-4532-82c8-f6efefe18fe4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:13.463589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:13.464209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.464475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.464744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.465500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=387dd720f3af430d8f5e165672dd1595) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:13.466030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:13.468670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb44ae-f1cc-447a-9283-3e1ab82e6dba None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:13.482207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 120/255] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:13 2022] GET /identity/v3/role_assignments?user.id=387dd720f3af430d8f5e165672dd1595&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=281c6762dde74c799ee78cea7a9f015c => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:13.483524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.483803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.484086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.536285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:13.565997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:13.567240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:13.579763 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2b1aa-6c78-42eb-8681-4e88855d8133 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:13.701679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:13.702332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:13.702618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:13.703098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/a10e551861c04001962265b2c03344f3/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:13.713844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, user_id=a10e551861c04001962265b2c03344f3, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:13.715881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:13.741340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 121/256] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:13.741976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 136/257] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:13 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/a10e551861c04001962265b2c03344f3/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:13.743532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:13.932075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:13.976933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224ee6c-4c10-46cc-976e-4561644ec825 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:14.032446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:14.033126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:14.033402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:14.033673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:14.050249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:14.056554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:14.057527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:14.058328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:14.059639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 122/258] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:14.070626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:14.273344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933e339-67f0-4602-be6f-4507b88ab2ed None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:14.292920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:14.358684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:14.359670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:14.360163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:14.360621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:14.368783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:14.368783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:14.368783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:14.384910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 137/259] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:14.402697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:14.449438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:14.564918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426eea-dc0d-40f1-ab51-696cb2e3a4a2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:14.660797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:14.661449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:14.661731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:14.662001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:14.671209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:14.695412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf86fb-f71f-449c-b1f5-bf79ab42a21b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:14.705748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:14.711030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:14.711907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:14.712899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:14.726675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 123/260] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:14.733679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:14.825105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:14.825694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:14.825938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:14.826207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:14.828546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:14.830041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:14.831782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 138/261] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:14 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:14.844789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:15.009451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:15.037098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b3aa5-c703-474a-9b7b-01c7d8716fb3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:15.076793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:15.077839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.078385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.078853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.112936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc06a8-5faf-4b2f-8e80-d444059f2a82 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:15.157433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:15.159231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937994-0ac0-448c-82c8-ca9c3c98a110 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:15.167505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:15.168127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.168399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.168666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.169380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:15.169680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:15.171460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d0edf-9144-4632-bb95-51362f727481 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:15.190558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 124/262] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:15.191840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ddd8-d05f-4680-8de9-4fb2a004abdd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.192125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ddd8-d05f-4680-8de9-4fb2a004abdd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.192401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9ddd8-d05f-4680-8de9-4fb2a004abdd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.204641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 125/263] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:15.207509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15ad3-0910-42cb-a7fd-5e1994cbbbfb None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.207789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15ad3-0910-42cb-a7fd-5e1994cbbbfb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.208061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb15ad3-0910-42cb-a7fd-5e1994cbbbfb None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.209467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 126/264] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:15.222662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb15ad3-0910-42cb-a7fd-5e1994cbbbfb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:15.255749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:15.284164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 139/265] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:15.285806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8560-764d-40b9-973b-7fd8100f0161 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.286285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8560-764d-40b9-973b-7fd8100f0161 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.286748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8560-764d-40b9-973b-7fd8100f0161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.321176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-916a8560-764d-40b9-973b-7fd8100f0161 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:15.323801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-916a8560-764d-40b9-973b-7fd8100f0161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:15.379648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:15.475949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 140/266] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:15.476938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb15ad3-0910-42cb-a7fd-5e1994cbbbfb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:15.486288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.488308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.488823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.541748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:15.542957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:15.608780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:15.609889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.610364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.610853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] PATH_INFO: `/v3/users/3942de4e537145adb734b38271c9f8c5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.612189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] RBAC: Authorizing `identity:get_user(user_id=3942de4e537145adb734b38271c9f8c5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:15.622113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:15.624221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 127/267] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:15 2022] GET /identity/v3/users/3942de4e537145adb734b38271c9f8c5 => generated 283 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:15.625207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:15.857462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63bf9b-b5e5-4c8f-95dd-314b175231c7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:15.888784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 141/268] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:15.888784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:15.898221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:15.944034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:15.944034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:15.944034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:15.944034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:15.944617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:15.947197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:15.949726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 128/269] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:15 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:15.949726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:15.991804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:16.176798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df521c0-475b-4b12-bc2f-4e54fa11abbd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.225580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820889a-41a5-4537-8af1-580ffd28f425 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.249727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.251825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.252397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.253333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.272144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.273444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.274332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.274995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.276178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:16.277697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:16.279243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 129/270] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:16.284392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:16.343829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:16.345319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:16.368340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:16.390154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:16.420655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cb359-fa0b-46ac-ba2d-c93da7cc84d5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.459942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.460469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.460741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.461037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.461352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 142/271] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:16.461757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=3942de4e537145adb734b38271c9f8c5) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:16.462060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:16.462225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:16.463498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79b625-9aab-43f2-b5d8-c178d1db493b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:16.472201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 130/272] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:16 2022] GET /identity/v3/role_assignments?user.id=3942de4e537145adb734b38271c9f8c5&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:16.473812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65097-2f84-4866-a09b-6179d0ad15e3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.474092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65097-2f84-4866-a09b-6179d0ad15e3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.474761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65097-2f84-4866-a09b-6179d0ad15e3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.476534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 131/273] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:16.482115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65097-2f84-4866-a09b-6179d0ad15e3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:16.614676 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d97d7-33b7-42a3-8f8c-0bb1137103f3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.656584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65097-2f84-4866-a09b-6179d0ad15e3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.675543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.676183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.678964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.678964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.682356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:16.697905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:16.699750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-0b18d53b-6d2f-42c6-b3a9-65c19af61ca0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:16.704845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:16.705788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 143/274] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:16.711494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe472ed-25b8-4667-b9c7-063d7aa7e06c None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.712384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe472ed-25b8-4667-b9c7-063d7aa7e06c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.712384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe472ed-25b8-4667-b9c7-063d7aa7e06c None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.712384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 144/275] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:16.712384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe472ed-25b8-4667-b9c7-063d7aa7e06c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:16.722526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.723137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.723783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.724062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.725592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:16.727183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa79bd-8510-4139-b613-3d7568370848 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:16.750156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 132/276] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:16 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:16.751507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d33c-c23e-463a-a447-29bdaecfc34e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.751864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d33c-c23e-463a-a447-29bdaecfc34e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.752878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3d33c-c23e-463a-a447-29bdaecfc34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.776374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7af3d33c-c23e-463a-a447-29bdaecfc34e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:16.777958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7af3d33c-c23e-463a-a447-29bdaecfc34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:16.859074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe472ed-25b8-4667-b9c7-063d7aa7e06c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:16.902626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:16.903269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.903535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.903805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.905275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:16.907772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:16.910536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 145/277] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:16 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:16.910536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:16.944241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 133/278] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:16.945753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:16.946119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:16.946460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:16.973498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:16.975421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:17.017034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:17.090714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c787c9-ce0a-46e9-8864-4569e702786e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.096215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 134/279] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:17.097403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.144840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.145968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.147409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.147864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.148604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:17.149003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:17.150713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:17.164692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 146/280] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:17.170976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.172573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:17.324862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368d1f0-468d-4a8d-a972-06f5e403c50f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.356720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deabc2-75d2-43b1-be97-37514c631799 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.361247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:17.373507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.374764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.375429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.375832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] PATH_INFO: `/v3/users/186719a82fa14c0e8eae13836a8b9eb7` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.395842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] RBAC: Authorizing `identity:get_user(user_id=186719a82fa14c0e8eae13836a8b9eb7)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:17.398043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:17.400292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 147/281] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/users/186719a82fa14c0e8eae13836a8b9eb7 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:17.401006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.401554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.401784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.402071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.402340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.407120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=3942de4e537145adb734b38271c9f8c5) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:17.407120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:17.407120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:17.412858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 135/282] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/role_assignments?user.id=3942de4e537145adb734b38271c9f8c5&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:17.413675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.579924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a855a1-3300-406e-819c-32e17468be90 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.583219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:17.594248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34468b-56ee-444d-9751-276f834a611b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.637021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.638113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.638644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.639125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.647638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.648779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.649200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.649638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.651558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:17.658591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:17.659658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:17.660667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:17.662737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 136/283] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:17.664793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:17.668165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:17.670204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:17.671260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:17.672233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:17.674388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 148/284] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:17.676315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.743214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:17.813694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d824f-c270-4519-95b8-dbab48006d03 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.828878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aef2d-4f96-4acd-a9f8-9bee94f6a73c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:17.859015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.859862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.860187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.860555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.861567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, user.id=186719a82fa14c0e8eae13836a8b9eb7, scope.system=all) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:17.862002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:17.863671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:17.870807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 137/285] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/role_assignments?user.id=186719a82fa14c0e8eae13836a8b9eb7&scope.system=all&role.id=b24f159614534214a245691482a99191 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:17.871818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.877925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:17.878814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:17.879235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:17.879675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:17.880512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:17.881721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:17.883363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:17.897844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 149/286] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:17.904750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:17.919850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:18.009021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3243e7-e939-4687-a539-f9f81bbbd271 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.032924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aceb0b-2666-442e-8745-44efd05efa2e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.041843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:18.067783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.068487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.068848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.069092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.069946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:18.070324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.071799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.086591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.087624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.088120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.088593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] PATH_INFO: `/v3/users/a10e551861c04001962265b2c03344f3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.091274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] RBAC: Authorizing `identity:get_user(user_id=a10e551861c04001962265b2c03344f3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.093200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.095268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 138/287] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:18.097474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 150/288] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:17 2022] GET /identity/v3/users/a10e551861c04001962265b2c03344f3 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:18.105889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:18.107072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:18.235959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:18.245922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665cf0e3-3e57-4a40-b87d-9ad1bf3be24a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.272797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745699-4909-420a-98e4-551808d3c5dc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.311948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.312618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.312969 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.314600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] PATH_INFO: `/v3/users/387dd720f3af430d8f5e165672dd1595` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.320537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] RBAC: Authorizing `identity:get_user(user_id=387dd720f3af430d8f5e165672dd1595)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.320537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.322806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 139/289] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:18 2022] GET /identity/v3/users/387dd720f3af430d8f5e165672dd1595 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:18.328808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:18.342290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.342911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.343189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.343463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.431580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:18.487209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.488598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.552287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8827-48e0-4390-a9cd-f3e98b38ed63 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.609030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.609844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.611469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.611757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.620159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.620159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.623452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 140/290] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:18 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:18.628565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:18.682604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:18.764117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 151/291] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:18.780401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:18.812785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5d28-8e64-4e25-a8de-e23c5d4610ad None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:18.888783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:18.888783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:18.888783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:18.889141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/387dd720f3af430d8f5e165672dd1595/roles/281c6762dde74c799ee78cea7a9f015c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:18.896987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, user_id=387dd720f3af430d8f5e165672dd1595, role_id=281c6762dde74c799ee78cea7a9f015c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:18.900789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:18.918660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 141/292] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:18 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/users/387dd720f3af430d8f5e165672dd1595/roles/281c6762dde74c799ee78cea7a9f015c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:18.975130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:19.054018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d7ed0-a2ef-45fe-9186-09bf69ad1f17 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:19.097060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:19.097939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.098365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.098784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.103495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:19.105165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd1b02-dca9-4684-ae47-4f722d26f911 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:19.108590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 152/293] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:18 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:19.118313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:19.142147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62772-f7ae-4c45-8cd7-c1833538f63c None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.142446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62772-f7ae-4c45-8cd7-c1833538f63c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.142770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62772-f7ae-4c45-8cd7-c1833538f63c None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.144285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 153/294] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:19.150783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58893-04b4-47e8-be9f-da04a8c0dc40 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.151327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58893-04b4-47e8-be9f-da04a8c0dc40 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.151789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f58893-04b4-47e8-be9f-da04a8c0dc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.174341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f9f58893-04b4-47e8-be9f-da04a8c0dc40 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:19.175939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f9f58893-04b4-47e8-be9f-da04a8c0dc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:19.228728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:19.258794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b28e69-6a41-4589-a7eb-d50b7c43e075 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:19.297810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 154/295] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 10:30:19.316631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:19.317204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.317484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.317765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.319758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=a10e551861c04001962265b2c03344f3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:19.320268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:19.321994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ba06-3aa9-4e0b-becf-2e7e6d47c1d8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:19.333168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 142/296] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:19 2022] GET /identity/v3/role_assignments?user.id=a10e551861c04001962265b2c03344f3&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b24f159614534214a245691482a99191 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:19.424695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60faec-955e-4be2-b712-35e1ae82627d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.424695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60faec-955e-4be2-b712-35e1ae82627d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.424695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60faec-955e-4be2-b712-35e1ae82627d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.424695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 155/297] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:19.430546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.431077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.431523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.463152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:19.464630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:19.586358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 143/298] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:19.618514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60faec-955e-4be2-b712-35e1ae82627d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:19.711367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:19.748323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60faec-955e-4be2-b712-35e1ae82627d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:19.799370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:19.799370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:19.799370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:19.799370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:19.820217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:19.825209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:19.826098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:19.826888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 156/299] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:19.833986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:19.949915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:19.951467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:19.972877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32980688-bdbb-4d24-819c-baa3f6df29f6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.010049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.010660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.010932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.011199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.011958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:20.012265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:20.013765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:20.024123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 144/300] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:20.031110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:20.059378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff91002-0a9c-40af-9f33-39fdd3e6109c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.090483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:20.096027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.097031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.097551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.098008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.099399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:20.101783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:20.103882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 157/301] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:20.109157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:20.142247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e2d82-2210-4d40-acd7-aa60edf1e5cd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.178490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.179458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.179951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.180324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] PATH_INFO: `/v3/users/d8a0f80d77204bd78119593b3b24d699` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.194986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:20.199201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a0f80d77204bd78119593b3b24d699)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:20.200748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3240f91-d1d5-451f-91a3-997df38c0321 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:20.202685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 145/302] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:20 2022] GET /identity/v3/users/d8a0f80d77204bd78119593b3b24d699 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:20.204017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f199-bd81-4429-8c76-82632993cb56 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.204451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f199-bd81-4429-8c76-82632993cb56 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.204720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3f199-bd81-4429-8c76-82632993cb56 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.205927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 146/303] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:20.208302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f199-bd81-4429-8c76-82632993cb56 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:20.238296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13c163-6711-4cc6-ab7e-8e506b47508c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.281774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.282394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.283162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.283446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] PATH_INFO: `/v3/groups` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.284368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:20.286029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeec6c-8de8-45af-a688-144f9bddbcd5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:20.307351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 158/304] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 31 10:30:20 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:20.308943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.309371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.309824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.331711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3f199-bd81-4429-8c76-82632993cb56 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.337809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:20.339293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:20.397629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.398603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.399085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.399509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.400504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, user.id=d8a0f80d77204bd78119593b3b24d699, scope.system=all) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:20.400984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:20.402819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:20.409433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 147/305] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 31 10:30:20 2022] GET /identity/v3/role_assignments?user.id=d8a0f80d77204bd78119593b3b24d699&scope.system=all&role.id=281c6762dde74c799ee78cea7a9f015c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:20.432354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:20.452344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 159/306] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:20.734846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:20.812780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:20.850223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7a5e6-0b6c-41a4-bbcf-8b991193cfbc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:20.886832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:20.887456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:20.887731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:20.888000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:20.899043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:20.903841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:20.904715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:20.905538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 148/307] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:20.910948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:21.024250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36cf8f-88b8-4cad-8938-217492d893b0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:21.062348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:21.062964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.068780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.068780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.068780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:21.068780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:21.068780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0d00-ade5-45e1-be6a-0c47f7e7f198 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:21.079158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 160/308] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:21.080541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:21.188388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d4cb8-a414-40e6-ac24-867fd6eb5f3e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:21.198739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ad15-b3cc-411d-ae7e-42951b9ec5bd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.199322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ad15-b3cc-411d-ae7e-42951b9ec5bd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.199791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ad15-b3cc-411d-ae7e-42951b9ec5bd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.201647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 161/309] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:21.206667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.207153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.207612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.221149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:21.226571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:21.227980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:21.229729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:21.230807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.231240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.231524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] PATH_INFO: `/v3/users/186719a82fa14c0e8eae13836a8b9eb7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.233706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] RBAC: Authorizing `identity:get_user(user_id=186719a82fa14c0e8eae13836a8b9eb7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:21.235169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:21.236964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 149/310] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:21 2022] GET /identity/v3/users/186719a82fa14c0e8eae13836a8b9eb7 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:21.244295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:21.300042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:21.336558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 162/311] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:21.374674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44a388-0a3d-47de-9676-92ee1ab6f660 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:21.411789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:21.413269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.413552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.413830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] PATH_INFO: `/v3/system/users/186719a82fa14c0e8eae13836a8b9eb7/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.415279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=186719a82fa14c0e8eae13836a8b9eb7, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:21.416683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:21.428985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 150/312] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 31 10:30:21 2022] PUT /identity/v3/system/users/186719a82fa14c0e8eae13836a8b9eb7/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:30:21.611717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:21.715944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb6922-25f0-4dbf-aa2c-89950ecdc13f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:21.752973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:21.754003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.754472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.754929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.766422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:21.772525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:21.773423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:21.774206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:21.776271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 163/313] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:21.782145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:21.849646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:21.898685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b04b-ee1a-405e-9468-5c3466fb4716 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:21.935023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:21.936032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:21.936525 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:21.937027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:21.937914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:21.938407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:21.939991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:21.950329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 151/314] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:21.956496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.005745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.066533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101c242-848b-45bf-acff-bcf4fc7fa0cc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:22.103147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:22.104357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.104896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.105412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] PATH_INFO: `/v3/users/387dd720f3af430d8f5e165672dd1595` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.106822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] RBAC: Authorizing `identity:get_user(user_id=387dd720f3af430d8f5e165672dd1595)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:22.108472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f130e34-9d5a-4de6-8e9d-c176188b109b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:22.110619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 164/315] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:21 2022] GET /identity/v3/users/387dd720f3af430d8f5e165672dd1595 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:22.117931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.227714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb649b-4a7a-48ea-a6b2-99757750522a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:22.245803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.264373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:22.265359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.265857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.266319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.338151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:22.339993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3754f29-5d4d-4e81-9aa9-816369126cef None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:22.419102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9427e8-2ddd-4d16-bb6b-2fd5cd1f817e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.419441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9427e8-2ddd-4d16-bb6b-2fd5cd1f817e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.419649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9427e8-2ddd-4d16-bb6b-2fd5cd1f817e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.421310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 165/316] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:22.422486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071acbf-af25-428e-9ea0-648239319024 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.422762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071acbf-af25-428e-9ea0-648239319024 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.423058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071acbf-af25-428e-9ea0-648239319024 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.424795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 166/317] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:22.426155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.426431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.426699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.447399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:22.448582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:22.456347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 152/318] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:22.456347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.456347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.456347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.478471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:22.479685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:22.495058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.520047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 167/319] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:22.521116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.568699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 153/320] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:22.569757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.636816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d83ed-42e8-45ea-91a4-aa4def94b558 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:22.672364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:22.673333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.673804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.674306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.675650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:22.677381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:22.679769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 168/321] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:22 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:22.686119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.792931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a519092-09b2-46c6-81ca-c33a5844ae39 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:22.805631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.842197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:22.842804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:22.843084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:22.843352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:22.844101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, scope.project.id=78371c82e8c941c5933a24a007ad3fba, user.id=387dd720f3af430d8f5e165672dd1595) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:22.844391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:22.845876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:22.853608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 154/322] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:22 2022] GET /identity/v3/role_assignments?user.id=387dd720f3af430d8f5e165672dd1595&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=281c6762dde74c799ee78cea7a9f015c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:22.854496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:22.872012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.950644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d3441-d67b-4f3b-9569-162694a40e68 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:22.965186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:22.986612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a2f16-9441-4c16-a143-b5d8bf67b57d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:23.002183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.003173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.003643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.004110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.016043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:23.021794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:23.022711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:23.023512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:23.026178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 169/323] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:23.031863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:23.034842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.035482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.035759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.036029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.037268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:23.038753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:23.040447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 155/324] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:23.047606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:23.158679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:23.162934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594bde7-bd74-48aa-9537-4884bb8a5822 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:23.181368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748c23-8d57-4ffa-8f4b-5343e6d11636 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:23.201196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.201797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.202067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.202337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.202988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:23.203285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:23.204656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:23.216147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 170/325] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:23.219769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.220465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.220820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.221092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] PATH_INFO: `/v3/groups` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.221600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:23.221757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:23.223184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:23.242546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 156/326] 10.222.0.70 () {60 vars in 1134 bytes} [Wed Aug 31 10:30:23 2022] POST /identity/v3/groups => generated 226 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:23.254976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:23.339713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfe778-301c-46af-b773-bb9f8034b9fe None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:23.376138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.376797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.377078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.377349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] PATH_INFO: `/v3/users/d8a0f80d77204bd78119593b3b24d699` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.378485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a0f80d77204bd78119593b3b24d699)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:23.379958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e687767-8885-4cd0-b350-07b8239685f5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:23.382311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 171/327] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:23 2022] GET /identity/v3/users/d8a0f80d77204bd78119593b3b24d699 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:23.388246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:23.468683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc9e6-4f5e-49dd-86e0-f61c6360d9af None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.468992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc9e6-4f5e-49dd-86e0-f61c6360d9af None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.469265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc9e6-4f5e-49dd-86e0-f61c6360d9af None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.470603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 172/328] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:30:23.475934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.476213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.476489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.496260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:23.497489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:23.510229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f3eb9-abe5-438b-b2a4-c46bd8c6b126 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:23.561601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:23.562746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:23.563192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:23.563987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] PATH_INFO: `/v3/system/users/d8a0f80d77204bd78119593b3b24d699/roles/281c6762dde74c799ee78cea7a9f015c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:23.565936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d8a0f80d77204bd78119593b3b24d699, role_id=281c6762dde74c799ee78cea7a9f015c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:23.567753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:23.578197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 157/329] 10.222.0.70 () {58 vars in 1334 bytes} [Wed Aug 31 10:30:23 2022] PUT /identity/v3/system/users/d8a0f80d77204bd78119593b3b24d699/roles/281c6762dde74c799ee78cea7a9f015c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:23.593694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 173/330] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:23.877662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:23.884925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:23.989390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191f1bb-f6a4-48fe-bfac-08ec9f5c1b0a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:24.026538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:24.027534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:24.028042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:24.028534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:24.040432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:24.046159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:24.047065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:24.047866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:24.055911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 158/331] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:24.057632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:24.089366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:24.187804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33af2-ffcf-4b6c-ba14-f9053ca354e0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:24.235810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:24.236420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:24.236697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:24.236996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:24.237662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:24.237964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:24.239338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:24.250116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 174/332] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:24.257831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:24.352786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:24.405280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92e57e-6bb1-40a9-b86c-7b80a00c01cf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:24.447325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:24.448347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:24.448858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:24.449337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] PATH_INFO: `/v3/users/186719a82fa14c0e8eae13836a8b9eb7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:24.453548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] RBAC: Authorizing `identity:get_user(user_id=186719a82fa14c0e8eae13836a8b9eb7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:24.455238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8caa0c-010c-485e-87b2-b3c8a779b47b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:24.457094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 159/333] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:24 2022] GET /identity/v3/users/186719a82fa14c0e8eae13836a8b9eb7 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:24.465871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:24.608091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:24.619916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c33bd-a55d-41d8-9cc5-633fb3ea0b71 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:24.674284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:24.674923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:24.675194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:24.675469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:24.676213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] RBAC: Adding query filter params (role.id=b24f159614534214a245691482a99191, user.id=186719a82fa14c0e8eae13836a8b9eb7, scope.system=all) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:24.676519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:24.678255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27555e5-4f69-4484-8ee4-2c55a078ded9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:24.696007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 175/334] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 31 10:30:24 2022] GET /identity/v3/role_assignments?user.id=186719a82fa14c0e8eae13836a8b9eb7&scope.system=all&role.id=b24f159614534214a245691482a99191 => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:25.767676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc91e-e1e6-4625-a4da-438e25d50e1f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:25.768678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc91e-e1e6-4625-a4da-438e25d50e1f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:25.769191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badc91e-e1e6-4625-a4da-438e25d50e1f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:25.771375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 160/335] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:25.784792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a112-df19-43a7-9cde-6053fe3167d8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:25.784792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a112-df19-43a7-9cde-6053fe3167d8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:25.784792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06a112-df19-43a7-9cde-6053fe3167d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:25.817241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ed06a112-df19-43a7-9cde-6053fe3167d8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:25.819020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ed06a112-df19-43a7-9cde-6053fe3167d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:25.918509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 176/336] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:26.003430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764731-103b-466d-82de-cd458bf69cde None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.004055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764731-103b-466d-82de-cd458bf69cde None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.004555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764731-103b-466d-82de-cd458bf69cde None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.006523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 161/337] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:26.011926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.012211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.012487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.037241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:26.038512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:26.130970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8fae-f340-43e4-93ea-9d8f030a8394 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.131618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8fae-f340-43e4-93ea-9d8f030a8394 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.132091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8fae-f340-43e4-93ea-9d8f030a8394 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.133665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 162/338] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:26.138801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.139344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.139815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.166343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 177/339] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:26.185286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:26.186492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:26.315753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:26.330047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 163/340] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:26.332630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:26.471235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4cb2b-6354-4963-a057-482029ad1462 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:26.511782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:26.512409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.512680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.512971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.523439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:26.528256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:26.529178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:26.530568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 178/341] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:26.535219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:26.619565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:26.663411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251676d-e444-4585-b2fe-680dc2e44df2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:26.700180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:26.700829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.701091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.701355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.702018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:26.702314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:26.704279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:26.717298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 164/342] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:26.721845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:26.751770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:26.854166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:26.899506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e639ad-28eb-42de-a35e-1e1a45d49985 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:26.928938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bbd2c-41ad-447f-85c2-c2730c8d8ffe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:26.939885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:26.940515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.940813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.941214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] PATH_INFO: `/v3/users/d8a0f80d77204bd78119593b3b24d699` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.942599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] RBAC: Authorizing `identity:get_user(user_id=d8a0f80d77204bd78119593b3b24d699)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:26.945273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b345-277c-4fef-8d00-1d429de74e35 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:26.947194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 179/343] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:30:26 2022] GET /identity/v3/users/d8a0f80d77204bd78119593b3b24d699 => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:26.953165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9c02-3911-42c1-976c-aa7f82594c11 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.953694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9c02-3911-42c1-976c-aa7f82594c11 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.954143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9c02-3911-42c1-976c-aa7f82594c11 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.955634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 180/344] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:26.956621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9c02-3911-42c1-976c-aa7f82594c11 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:26.969144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:26.983122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:26.983743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:26.984223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:26.984669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:26.996231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:27.002146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:27.003050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:27.003858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:27.007722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 165/345] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:27.008709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:27.080288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9c02-3911-42c1-976c-aa7f82594c11 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.121368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.122191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.122535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.122871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.126079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:27.126809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754fbbe-f9a4-4f6e-a31e-2c1af0708b91 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.136440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-cf0a8325-8cca-44e9-b19a-dd157f739d67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:27.141951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:27.142876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:27.143779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:27.149009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 181/346] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:27.151601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.151828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.152100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.174155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.175153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.175633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.176102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.177245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] RBAC: Adding query filter params (role.id=281c6762dde74c799ee78cea7a9f015c, user.id=d8a0f80d77204bd78119593b3b24d699, scope.system=all) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:27.178173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:27.178709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:27.179410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:27.180577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:27.195064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 166/347] 10.222.0.70 () {56 vars in 1308 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/role_assignments?user.id=d8a0f80d77204bd78119593b3b24d699&scope.system=all&role.id=281c6762dde74c799ee78cea7a9f015c => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:27.196200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:27.250001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:27.310492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 182/348] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:27.311467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:27.330269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce5011-812b-4b7b-a305-4e044b0e204a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.398351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.399351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.399828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.400292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.401203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:27.401779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:27.408793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:27.426175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 167/349] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:27.433916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:27.526567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed1f15-6ac7-45dd-bdfb-8a4e97ca788b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.561222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:27.574522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.575159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.575489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.575770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.576430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:27.576729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:27.580778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:27.587846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 183/350] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:27.593390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:27.653997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10ec20-b5b2-4e7d-b5ef-aa7c1292e986 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.661627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:27.707908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54c312-a980-4328-8f1d-7732f86174e1 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:27.747357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.748476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.748963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:27.749272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.749568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.749842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.750110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.750390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.824662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:27.839821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:27.841461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c4c3-bc4e-4be8-a947-d60bfeda4728 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:27.888355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:27.889888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:27.981108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 184/351] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:27.981108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eb89e-d4e4-43b6-bb9d-36a2a8f12d0f None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:27.981108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eb89e-d4e4-43b6-bb9d-36a2a8f12d0f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:27.981108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eb89e-d4e4-43b6-bb9d-36a2a8f12d0f None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:27.985712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 185/352] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:27.985712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eb89e-d4e4-43b6-bb9d-36a2a8f12d0f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.030678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 168/353] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:28.032200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.038161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.110428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.132198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eb89e-d4e4-43b6-bb9d-36a2a8f12d0f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.176721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdc472-c382-4379-ab94-d818e8005ee3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.184099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.184733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.185066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.185333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.199894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a0d12819-163f-4b71-a86f-1d29abf62e85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:28.205255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:28.206401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:28.207357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:28.210442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 186/354] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:28.212966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.213398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.213819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.224575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.227768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.228054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.228327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.229763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:28.231297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:28.232953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 169/355] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:28.233719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.235833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:28.237066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:28.318695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 187/356] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:28.319813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.331840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.369353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2edf1-4582-4fcd-9652-9184fe9b86f3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.409778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.410412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.410688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.410957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.412872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:28.415191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8942cf-069a-47b1-9531-c59ba2c58a23 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:28.420415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 170/357] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:28.420415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279caa-4815-4657-97a0-7969b61e3ca7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.420415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279caa-4815-4657-97a0-7969b61e3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.420415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3279caa-4815-4657-97a0-7969b61e3ca7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.420415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 171/358] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:28.422131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279caa-4815-4657-97a0-7969b61e3ca7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.431543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.462434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7258f59-acb8-45fd-b59a-6c68adf776d6 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.520010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.520535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.521662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.521960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.522670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:28.522973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:28.524605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:28.535806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 188/359] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:28.539631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.574169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3279caa-4815-4657-97a0-7969b61e3ca7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.620343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.621014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.621287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.621556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.627907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:28.629411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a2dbf-daeb-4518-a8ff-917e3e1900b3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:28.631756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 172/360] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:28.633028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.633211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.633477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.640505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.653597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:28.655389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:28.672684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030b05e-b753-43aa-91b7-40a31c34ec58 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.716608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.717627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.718049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.718463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.719742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:28.721216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:28.722778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 189/361] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:28.723542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.734828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.745939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 173/362] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:28.748120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:28.862616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d5db2-3bae-4386-bd08-1c0b76bdd108 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.899618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ce29f-b9ff-4478-9908-0896eb332c44 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:28.904161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.904836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.905081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.905351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.959475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:28.959678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:28.959886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:28.960108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:28.962290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:28.972703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:28.978218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:28.979137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:28.980142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 174/363] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:28.980877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.011891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.014047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.026867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.116886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702482f8-3b06-484f-8131-fe4d78941465 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.139087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 190/364] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:29.139938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.165688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.166293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.166567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.166837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.167950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b24f159614534214a245691482a99191, scope.project.id=981d055b44f141968d64b673f5201015) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:29.167950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.169349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.175053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 175/365] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:28 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b24f159614534214a245691482a99191 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:29.175849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.256751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.279898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca502d9e-c269-42bd-a9d7-3cab2f8d3db3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.294221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.321607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453333c-a13d-4d28-815f-7e40000a3c2e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.327657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.328275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.328553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.328867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.329602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=981d055b44f141968d64b673f5201015) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:29.329908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.331342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.337920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 191/366] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:29.338757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.376949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.377781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.378063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.378336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.379595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:29.379905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.382617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.395436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 176/367] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:29.397570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.507807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb7a3-49a1-4ebd-b10a-b2288aad85c9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.556738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.557689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.558510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4a22e-2d4e-46d8-8dab-7c6123851ddc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.558623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.558874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.581857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:29.589081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:29.590007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:29.590837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:29.593455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 192/368] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:29.594553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.594658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.619063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44590-1366-4c73-9641-92de48056260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.620268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44590-1366-4c73-9641-92de48056260 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.621387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44590-1366-4c73-9641-92de48056260 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.622104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa44590-1366-4c73-9641-92de48056260 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.623745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa44590-1366-4c73-9641-92de48056260 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.625490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa44590-1366-4c73-9641-92de48056260 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.628067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 177/369] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:29.634014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44590-1366-4c73-9641-92de48056260 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.644434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.737479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbfca-aea1-444d-8bc6-cda8d88589dd None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.785545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa44590-1366-4c73-9641-92de48056260 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:29.785888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.788338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.796783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.796783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.833332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:29.834308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:29.834643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:29.834924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:29.835701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:29.836085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.840673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.851447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 178/370] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:29.856688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:29.885326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:29.887469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:29.924790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:29.951090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.032777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c88aec-a034-4c7f-9b0b-28d5dd676bb2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.032964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 193/371] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:30.032964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.091874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.092518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.092828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.093129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.094251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.095729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.098000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 179/372] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:29 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:30.099438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.175265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f21aa8-6699-4a4f-a532-58457b8f8940 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.207870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.214734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.215357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.215633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.215906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.238922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767151-48ce-49d0-9d68-fcf308fae59c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.262310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.289925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.290566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.290843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.291113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.292255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.293747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.295768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 180/373] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:30.296543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.307464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.308986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.456749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 194/374] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:30.457402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.463735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f833-8285-4ad6-aff6-de8e516444da None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.518282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.540415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.543806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.543806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.543806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.544543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b24f159614534214a245691482a99191, scope.project.id=78371c82e8c941c5933a24a007ad3fba) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:30.544880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.546490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.555011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 181/375] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b24f159614534214a245691482a99191 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:30.555875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.671182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3be0-ef5f-449d-8c5f-aa9311437722 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.725609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.760127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.760798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.761078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.761343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.762462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.767019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.767019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 195/376] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:30.777006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:30.870348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59b536-a7ca-4e1b-b4e2-59903782cd32 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.921680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:30.925801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67d209-9c2c-44c5-ae59-65fe97591309 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:30.978007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.978188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.978463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.978735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] PATH_INFO: `/v3/projects/6872bf7790f84367af06df6d64db20b3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.979600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:30.980420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:30.980919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:30.981422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:30.981539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] RBAC: Authorizing `identity:get_project(project_id=6872bf7790f84367af06df6d64db20b3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.982479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=78371c82e8c941c5933a24a007ad3fba) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:30.982958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.983193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:30.984862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:30.985252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 182/377] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/projects/6872bf7790f84367af06df6d64db20b3 => generated 344 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:30.993323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 196/378] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:30.995117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:31.120573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad54ff-2e07-41d4-bf6d-acb9cf8cf1aa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:31.140136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:31.160463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:31.162066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.162554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.163025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] PATH_INFO: `/v3/groups/a1a787069d854cc5b7f8e74969d24422` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.169215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a787069d854cc5b7f8e74969d24422)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:31.171014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61d6b5-80fd-4610-9e0b-e085fe166569 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:31.173200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 183/379] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:30 2022] GET /identity/v3/groups/a1a787069d854cc5b7f8e74969d24422 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:31.181900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:31.360839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff673baa-3acb-46aa-bc28-70ac7ce013ee None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:31.400513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:31.401263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.401618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.401928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.402659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] RBAC: Adding query filter params (group.id=a1a787069d854cc5b7f8e74969d24422, role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=6872bf7790f84367af06df6d64db20b3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:31.402971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:31.404407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0482558-346a-4222-bc15-025a6c151443 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:31.410372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 197/380] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:31 2022] GET /identity/v3/role_assignments?group.id=a1a787069d854cc5b7f8e74969d24422&scope.project.id=6872bf7790f84367af06df6d64db20b3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:31.523308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a89b2-811d-4687-8466-53afa86c8b84 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.523308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a89b2-811d-4687-8466-53afa86c8b84 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.523308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a89b2-811d-4687-8466-53afa86c8b84 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.524403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 184/381] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:31.529046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a84d-0102-4789-b6ff-0ef7f8e1591c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.529357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a84d-0102-4789-b6ff-0ef7f8e1591c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.529639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2a84d-0102-4789-b6ff-0ef7f8e1591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.562368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b5f2a84d-0102-4789-b6ff-0ef7f8e1591c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:31.563599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b5f2a84d-0102-4789-b6ff-0ef7f8e1591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:31.599347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:31.653858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 198/382] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:31.840508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6f03-8198-48f1-84dc-e924161aa13d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.840508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6f03-8198-48f1-84dc-e924161aa13d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.840508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb6f03-8198-48f1-84dc-e924161aa13d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.840508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 185/383] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:31.860519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:31.860519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:31.860519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:31.881786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:31.883310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:31.990272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb6f03-8198-48f1-84dc-e924161aa13d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:32.003260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 199/384] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:32.214026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb6f03-8198-48f1-84dc-e924161aa13d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:32.273673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:32.275097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:32.275097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:32.275097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:32.297935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:32.309568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:32.310497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:32.311768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 186/385] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:32.317240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:32.512044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:32.533693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:32.559868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e16808-b3a6-4f54-95d0-7d79c1d569de None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:32.613310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:32.629544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:32.630762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:32.631548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:32.631819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:32.632495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:32.632828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:32.634236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:32.663968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 200/386] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:32.670495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:32.715906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652b3e2-4235-4f47-acc2-eeac5e71da57 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:32.784176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:32.784741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:32.787293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:32.787293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:32.806124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:32.817785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:32.819054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:32.819906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:32.826621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 187/387] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:32.834370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:32.898920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30a012-ad41-45c1-939d-517d91c95b91 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:32.985930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:32.988872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:32.989675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:32.991443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:32.994148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:32.995976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd10e8-0541-4cf9-8128-5d501d1a877d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.001741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 201/388] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:32 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:33.003602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f033d9-f16a-4435-b2e4-11cd035051cd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.004121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f033d9-f16a-4435-b2e4-11cd035051cd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.004631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f033d9-f16a-4435-b2e4-11cd035051cd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.008176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 202/389] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:33.009418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f033d9-f16a-4435-b2e4-11cd035051cd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.036744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:33.048192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff709c-4acd-4ce0-8e4f-7293438adfb8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.051501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:33.106669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.110177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.110464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.110736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.111416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:33.111721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:33.115718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd37c46-303a-4fff-a04a-22a9477b84bd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.126736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 188/390] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:33.133025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.133314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.133592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.161834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f033d9-f16a-4435-b2e4-11cd035051cd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.165627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:33.166488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:33.203870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.206610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.207200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.207689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.209436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:33.211216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.213727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 203/391] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:33 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:33.214844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.269132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 189/392] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:33.270200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.325259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:33.339563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab209e-bbd8-4616-b926-8260bd24f2e4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.379199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.384794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.384794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.384794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.395111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:33.395111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.395111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 204/393] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:33 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:33.402001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.510004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:33.524417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523891c-06ef-4c7a-a16f-ea8527dfb3cf None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.604641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.607038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.607345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.607631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.611515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, group_id=061420eefbb543b9a7532e0c2aa869ee, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:33.612995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc195359-75d7-4cba-8236-374df476a522 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.620781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b34b0e-9c02-4578-8e80-37cb48b58bea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.643920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 190/394] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 31 10:30:33 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:33.645432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ed50-e08f-4240-b427-8de0753de73c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.646203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ed50-e08f-4240-b427-8de0753de73c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.646203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9ed50-e08f-4240-b427-8de0753de73c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.652784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 191/395] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:33.652784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9ed50-e08f-4240-b427-8de0753de73c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.691889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.696790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.696790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.696790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.696790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:33.700793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfb4a4-8d45-483e-a248-e55eabe4402d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:33.703236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 205/396] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:33 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:33.704702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.705117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.705464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.731822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:33.734211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:33.764447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:33.830599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9ed50-e08f-4240-b427-8de0753de73c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:33.862251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 206/397] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:33.863921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.905660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:33.906508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:33.906637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:33.906841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:33.940783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:33.944797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:33.945691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:33.946588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:33.952257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 192/398] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:33.955349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:33.984412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.024138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2e5e1-a030-4398-880b-8176950a7c33 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.065856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.067998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.068661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.069183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.071800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] RBAC: Authorizing `identity:create_grant(project_id=981d055b44f141968d64b673f5201015, group_id=061420eefbb543b9a7532e0c2aa869ee, role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:34.073611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532e95c-f21a-463e-9f2b-c2631932330c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:34.092434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 207/399] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 31 10:30:33 2022] PUT /identity/v3/projects/981d055b44f141968d64b673f5201015/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b5722621e10c4e1694a7eebeec0084eb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:34.092627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c204d-6586-49e9-a2f0-5595f8f3342e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.094387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf4e6-4a10-409d-bdf8-107e63a66b06 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.094894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf4e6-4a10-409d-bdf8-107e63a66b06 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.095535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcf4e6-4a10-409d-bdf8-107e63a66b06 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.102551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 208/400] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:34.104981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.105493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.105987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.127901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:34.131370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:34.140816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.213618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.214186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.214470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.214895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.215415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:34.215727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:34.217408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:34.225634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 209/401] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:34.232797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.246324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 193/402] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:34.257851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.415859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.472508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c49a6-c58f-4fcd-8d12-eead7d1000e9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.492484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7a575-4939-4fc1-a01d-f501129917b0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.555641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.556548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.557018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.557527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.566506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.567159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.567965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.568244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.569470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:34.570881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:34.573516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:34.577157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 194/403] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:34 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:34.578205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:34.579725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:34.580739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:34.581680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:34.582994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 210/404] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:34.585057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.591906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.729712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e778f6-9c25-4084-acbb-f1581b37f066 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.776351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60551e82-a4ef-467a-a4f5-c429a9ade5c8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:34.788989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.789897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.790328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.790842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.793941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:34.795404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:34.798404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 211/405] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:34 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:34.806151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.855342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:34.855983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:34.856259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:34.856525 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:34.875291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:34.887451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:34.888418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:34.889260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:34.897268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 195/406] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:34.898595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:34.905276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.923100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:34.964956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887e84-9286-4ce8-a60f-5c8bbb9e5769 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.014180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.015230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.015893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.016511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.017406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:35.017922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.019982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.037478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 212/407] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:35.038642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.103519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb223-3cf5-4bd5-9317-7487e1c8ee68 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.173605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.174264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.174541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.174813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.178264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, group_id=061420eefbb543b9a7532e0c2aa869ee, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.181379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.213167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 196/408] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 31 10:30:34 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:35.214281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.230089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0489-5e66-48cf-882a-cc6d870c6f6a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.290798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:35.299622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.300675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.301238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.303204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.304943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:35.305482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.314141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.328130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 213/409] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:35.335293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.381148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:35.491791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7cb1-502e-46fc-8db6-f13eddcb787e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.505258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95314f-a32c-49db-a088-89781b40b242 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.542247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.543818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.544242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.545407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.547048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.547495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.548229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.548610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.549207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.549863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] PATH_INFO: `/v3/groups/a1a787069d854cc5b7f8e74969d24422` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.551095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a787069d854cc5b7f8e74969d24422)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.551788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 197/410] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:35 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:35.554792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.555749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 214/411] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:35 2022] GET /identity/v3/groups/a1a787069d854cc5b7f8e74969d24422 => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:35.557907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.561633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.691192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:35.726583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa406e1-d9d6-48fc-bfd2-737da8177546 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.769790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.770977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.771872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.772159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] PATH_INFO: `/v3/projects/6872bf7790f84367af06df6d64db20b3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.773581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=6872bf7790f84367af06df6d64db20b3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.775632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.777637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 215/412] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:35 2022] GET /identity/v3/projects/6872bf7790f84367af06df6d64db20b3 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:35.783396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:35.853398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98e35-a7a0-4f32-9db1-b572265b26f8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:35.924395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:35.935221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:35.935896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.936186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.936470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.944264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:35.945789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492e8c-6b16-4f28-8f00-0fed846e078a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:35.948132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 198/413] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:35 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:35.949441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16e2bd-b762-410b-b062-f0b339182850 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:35.949730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16e2bd-b762-410b-b062-f0b339182850 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:35.952330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16e2bd-b762-410b-b062-f0b339182850 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:35.952330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 199/414] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:35.953057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16e2bd-b762-410b-b062-f0b339182850 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:36.000978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbf3ae-a516-4bbb-b31f-d7fc7a4d9ec0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:36.069823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:36.070452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:36.070743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:36.071538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] PATH_INFO: `/v3/projects/6872bf7790f84367af06df6d64db20b3/groups/a1a787069d854cc5b7f8e74969d24422/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:36.074597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] RBAC: Authorizing `identity:create_grant(project_id=6872bf7790f84367af06df6d64db20b3, group_id=a1a787069d854cc5b7f8e74969d24422, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:36.076134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654e29-61fb-4d60-91e1-11c274a1d73a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:36.083813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:36.108541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 216/415] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 31 10:30:35 2022] PUT /identity/v3/projects/6872bf7790f84367af06df6d64db20b3/groups/a1a787069d854cc5b7f8e74969d24422/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:36.111836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd87b-633b-4377-89f2-8d6636985d9e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:36.112128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd87b-633b-4377-89f2-8d6636985d9e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:36.112408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffd87b-633b-4377-89f2-8d6636985d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:36.132648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16e2bd-b762-410b-b062-f0b339182850 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:36.158385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c1ffd87b-633b-4377-89f2-8d6636985d9e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:36.161791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c1ffd87b-633b-4377-89f2-8d6636985d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:36.182281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:36.182281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:36.182589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:36.182814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:36.185538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] RBAC: Authorizing `identity:create_grant(project_id=78371c82e8c941c5933a24a007ad3fba, group_id=061420eefbb543b9a7532e0c2aa869ee, role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:36.187331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439388ff-a387-4a70-9e62-b622905c956c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:36.215425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 200/416] 10.222.0.70 () {58 vars in 1442 bytes} [Wed Aug 31 10:30:35 2022] PUT /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba/groups/061420eefbb543b9a7532e0c2aa869ee/roles/b5722621e10c4e1694a7eebeec0084eb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:30:36.373706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 217/417] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:36.420111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98dc-1c57-49fd-b103-6f8cff45990c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:36.420427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98dc-1c57-49fd-b103-6f8cff45990c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:36.420656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e98dc-1c57-49fd-b103-6f8cff45990c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:36.422115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 201/418] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:36.428625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:36.428960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:36.429227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:36.455620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:36.456823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:36.545097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 218/419] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:36.852485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e98dc-1c57-49fd-b103-6f8cff45990c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:36.935465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:36.968083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.027542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.030038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e98dc-1c57-49fd-b103-6f8cff45990c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:37.107947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:37.108573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.109047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.109474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.126614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:37.132579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:37.133570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:37.134372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:37.141053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 202/420] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:37.142931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:37.168433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1feb5b-7069-4ba0-a032-17a738575882 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:37.293494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:37.294194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.294433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.294707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.302958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c210f7-564a-491f-9db4-c730b3d919c1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:37.331246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.348198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:37.349511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.349743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.349985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.351057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:37.351361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:37.352790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:37.353418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:37.358665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:37.359635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:37.360451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:37.369207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 219/421] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:37.370532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 203/422] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:37.377321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:37.377720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:37.552681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18907a03-40a5-4459-83dc-d492a1ac82c8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:37.599489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:37.600845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.601336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.602239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.670967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.699047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:37.700890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:37.771317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874babe3-d5f1-407a-aa46-54c7f341d9eb None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:37.802716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.829124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 204/423] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:37.837015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:37.923040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:37.923585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.923860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.924128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.924887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:37.925123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:37.927010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2dadfe-ecff-4054-8f8c-f0a37d3b3502 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:37.943966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 220/424] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:37.946371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980478f-c0de-4c4c-b285-e01d2f84995d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:37.946899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980478f-c0de-4c4c-b285-e01d2f84995d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:37.947651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980478f-c0de-4c4c-b285-e01d2f84995d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:37.949129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:37.951583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 221/425] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:37.952514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980478f-c0de-4c4c-b285-e01d2f84995d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:37.983096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3cafc6-9e02-4751-9654-a46c030ff840 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:38.026220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:38.026853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.027133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.032793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.032793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:38.032793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887e51b-57d6-4264-9fae-a6f27786cd44 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:38.034322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 205/426] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:37 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:38.040255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.040533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.040830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.071732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:38.073563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:38.147129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980478f-c0de-4c4c-b285-e01d2f84995d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:38.191414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 206/427] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:38.193133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:38.236855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:38.237485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.240805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.240805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.295937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:38.320154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5544b8-e757-467a-b8ad-b5a6847d6e4e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:38.332918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:38.367047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:38.368165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.368700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.369223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.372571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:38.374294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:38.376298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 207/428] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:38 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:38.383777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:38.421471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:38.422858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120bf13-6de3-4b7a-bcee-1239a4d82378 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:38.508315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3a340-650b-4869-826f-e349278bd951 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:38.555236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:38.556180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.556783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.557260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.558191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b24f159614534214a245691482a99191, scope.project.id=981d055b44f141968d64b673f5201015) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:38.558716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:38.560383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:38.571991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 208/429] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:38 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b24f159614534214a245691482a99191 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:38.611466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:38.643304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:38.724830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 222/430] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:38.726125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d02b-b385-4af6-ab1e-ef024aec3368 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.726405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d02b-b385-4af6-ab1e-ef024aec3368 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.726727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321d02b-b385-4af6-ab1e-ef024aec3368 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.731974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 223/431] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:38.731974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56a6c-bc41-4b04-85af-41f7d67e0581 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.731974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56a6c-bc41-4b04-85af-41f7d67e0581 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.731974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56a6c-bc41-4b04-85af-41f7d67e0581 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.736027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 224/432] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:38.737599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3983-a0ed-4898-a86e-333fb5a4bd70 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.737891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3983-a0ed-4898-a86e-333fb5a4bd70 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.738168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a3983-a0ed-4898-a86e-333fb5a4bd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.759447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-061a3983-a0ed-4898-a86e-333fb5a4bd70 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:38.760567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-061a3983-a0ed-4898-a86e-333fb5a4bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:38.783844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca7ab8-e848-4039-b578-a48c0187bb8c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:38.828025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:38.828673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.831735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.831735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.846482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:38.854264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:38.855388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:30:38.856380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:38.858171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 209/433] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:38.858171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:38.863844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 225/434] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:38.869125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:38.869125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:38.869125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:38.876957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:38.900427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:38.902040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:38.956390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.001381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd40a4-e7f9-4a75-b56d-d9e9ec31b785 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.011966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 226/435] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:39.019753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.094289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.095354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.095354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.095531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] PATH_INFO: `/v3/projects/981d055b44f141968d64b673f5201015` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.097243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] RBAC: Authorizing `identity:get_project(project_id=981d055b44f141968d64b673f5201015)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.099330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.104888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 210/436] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:38 2022] GET /identity/v3/projects/981d055b44f141968d64b673f5201015 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:39.106898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.163934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65389a96-073f-4748-bbe6-12548ef41e02 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.198369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.209249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.210321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.210797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.211347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.212302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:39.212609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.214068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.223633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 227/437] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:39.225033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.235911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9cbd90-e1d3-43be-bd24-b382d305db98 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.277063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.278058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.278821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.279263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.280887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.282622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.285768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 211/438] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:39.286554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.304717 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.361994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840462e-5556-4d9d-a2c4-674f535647e3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.401590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.402215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.402509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.402780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.415973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:39.416587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dbf9-cc57-4283-a5a2-74a93450eb8d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:39.421589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:39.422720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 228/439] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:39.423804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.461116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.462041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.462467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.462748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.487433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.542675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc54d0-cf69-4839-86ed-d9d9529b4e27 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.547364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.548865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.561514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.583638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.584239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.584628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.584877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.586978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=981d055b44f141968d64b673f5201015) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:39.586978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.587293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.593370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 229/440] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=981d055b44f141968d64b673f5201015&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:39.593988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.684851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 212/441] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:39.685795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.738163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a3ff-9de8-4ec3-bf34-8adc6994e093 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.764786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.790060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.791000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.791500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.792096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.811014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:39.816837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:39.818395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 230/442] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:39.819202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.842725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bdde0-efe6-41b3-a669-d2aa6c7731b4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:39.858511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:39.898264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:39.899041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:39.899329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:39.899602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:39.900276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:39.900582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:39.904068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:39.913924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 213/443] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:39.914772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:39.985760 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389fdad-8e7d-482b-9b58-17edbf52af9c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.028696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.029356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.029632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.029901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.031022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.032468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.034160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 231/444] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:40.034882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.052231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff577209-0eb5-423e-b537-b731cda4a15e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.088960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.089673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.090023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.090394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.091132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:40.091507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.091944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.093092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.103811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 214/445] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:40.104662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.138201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.159169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7cf0d-4037-405e-94c5-9a6ccfe1cadb None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.195970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.196680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.197029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.197298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.213427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb7f7b-dd14-4df5-8b21-a25516e49daf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.249848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.250472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.250749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.251019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.252137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.253615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.255552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 215/446] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:40.256127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.270912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.272432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.321667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.369788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.373608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e80df-0d77-4a46-9ad3-7ce40b5bafb2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.384417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 232/447] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:40.385485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.413945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.415100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.415380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.415652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.493694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.495169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.495475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78061b8-5103-40d8-858a-db6a992e1329 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.533234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.533843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.534119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.534390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.535115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b24f159614534214a245691482a99191, scope.project.id=78371c82e8c941c5933a24a007ad3fba) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:40.535422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.537598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.543640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 233/448] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b24f159614534214a245691482a99191 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:40.544468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.570655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.634971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.641604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 216/449] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:40.646855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.704001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79751fea-466e-4531-a53f-ab8bed93a6be None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.764741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.765540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.765817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.766093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] PATH_INFO: `/v3/projects/78371c82e8c941c5933a24a007ad3fba` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.767225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] RBAC: Authorizing `identity:get_project(project_id=78371c82e8c941c5933a24a007ad3fba)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.769010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.776854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 234/450] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/projects/78371c82e8c941c5933a24a007ad3fba => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:40.780921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.806447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c92380-579c-45f8-869d-19c7d8ee4ffe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.858411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.858789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.859076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.859352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] PATH_INFO: `/v3/projects/6872bf7790f84367af06df6d64db20b3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.860518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] RBAC: Authorizing `identity:get_project(project_id=6872bf7790f84367af06df6d64db20b3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.862359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.864711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 217/451] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/projects/6872bf7790f84367af06df6d64db20b3 => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:40.871377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:40.901375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.942702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e63b8-2d78-42a4-bc24-dde2a5c3e82d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:40.961932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:40.987140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:40.987868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:40.988150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:40.988422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] PATH_INFO: `/v3/groups/061420eefbb543b9a7532e0c2aa869ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:40.991656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] RBAC: Authorizing `identity:get_group(group_id=061420eefbb543b9a7532e0c2aa869ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:40.993346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:40.995267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 235/452] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/groups/061420eefbb543b9a7532e0c2aa869ee => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:41.001566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a487-1328-4ad0-9c73-cae80b1f4643 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:41.001941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:41.041235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:41.042042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:41.042174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:41.042392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] PATH_INFO: `/v3/groups/a1a787069d854cc5b7f8e74969d24422` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:41.043584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] RBAC: Authorizing `identity:get_group(group_id=a1a787069d854cc5b7f8e74969d24422)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:41.045486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:41.047563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 218/453] 10.222.0.70 () {56 vars in 1180 bytes} [Wed Aug 31 10:30:40 2022] GET /identity/v3/groups/a1a787069d854cc5b7f8e74969d24422 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:41.053611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:41.115906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac0731-d2d4-44bf-8edb-ee2987701cfb None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:41.154714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:41.155134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:41.155411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:41.155685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:41.156417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] RBAC: Adding query filter params (group.id=061420eefbb543b9a7532e0c2aa869ee, role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=78371c82e8c941c5933a24a007ad3fba) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:41.156727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:41.158282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5502f2-1abd-417b-bde9-e46665d915a8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:41.166136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 236/454] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:41 2022] GET /identity/v3/role_assignments?group.id=061420eefbb543b9a7532e0c2aa869ee&scope.project.id=78371c82e8c941c5933a24a007ad3fba&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:41.175329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4bd2-c0e1-4949-8a59-49a84ec066c1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:41.215422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:41.216117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:41.216402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:41.216674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:41.217462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] RBAC: Adding query filter params (group.id=a1a787069d854cc5b7f8e74969d24422, role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=6872bf7790f84367af06df6d64db20b3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:41.217772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:41.219266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598058-78f7-4e9e-9ff0-f7f6c8aa1e28 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:41.223922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:41.228394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 219/455] 10.222.0.70 () {56 vars in 1376 bytes} [Wed Aug 31 10:30:41 2022] GET /identity/v3/role_assignments?group.id=a1a787069d854cc5b7f8e74969d24422&scope.project.id=6872bf7790f84367af06df6d64db20b3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:44.059402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3869-f008-4236-a1e3-c41ac210ab76 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.059877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3869-f008-4236-a1e3-c41ac210ab76 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.059877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b3869-f008-4236-a1e3-c41ac210ab76 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.061200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 237/456] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:44.068795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c9fb-5f3c-4c37-b959-9f10f2fe45fe None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.068795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c9fb-5f3c-4c37-b959-9f10f2fe45fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.068795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9c9fb-5f3c-4c37-b959-9f10f2fe45fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.105803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-39f9c9fb-5f3c-4c37-b959-9f10f2fe45fe None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:44.107252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-39f9c9fb-5f3c-4c37-b959-9f10f2fe45fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:44.359439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 220/457] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:44.571850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43854abb-8fef-4d99-874b-83283ffaa4db None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.572366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43854abb-8fef-4d99-874b-83283ffaa4db None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.572808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43854abb-8fef-4d99-874b-83283ffaa4db None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.574607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 238/458] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:44.579430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fe30-a20e-4d22-aeec-bbe891f84d69 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.579712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fe30-a20e-4d22-aeec-bbe891f84d69 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.579984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69fe30-a20e-4d22-aeec-bbe891f84d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.605829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9a69fe30-a20e-4d22-aeec-bbe891f84d69 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:44.607038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9a69fe30-a20e-4d22-aeec-bbe891f84d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:44.699097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 221/459] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:44.775711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43854abb-8fef-4d99-874b-83283ffaa4db None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:44.794388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:44.818353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766716a0-a5ac-4969-bdb6-9aa8ed0c2047 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.819002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766716a0-a5ac-4969-bdb6-9aa8ed0c2047 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.819486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766716a0-a5ac-4969-bdb6-9aa8ed0c2047 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.821044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 222/460] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:30:44.826230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.826735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.827219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.857749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:44.859306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:44.894508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43854abb-8fef-4d99-874b-83283ffaa4db None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:44.931117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:44.932143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:44.932620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:44.933126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:44.944978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:44.946889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:44.970538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:44.971490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:44.972366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:44.972366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:44.972366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:44.977407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 239/461] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:44.983773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.000159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.023298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 223/462] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:45.073126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.087402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.132588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5207-c6a7-4c6a-aaf1-bbbcff217406 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.168701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.169570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.170013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.170448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.171227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:45.171673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.173287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5d452-0843-4fb4-9f6a-ba2ec96ed117 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.186382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 240/463] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:45.187822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970dfd8-617b-422a-b80c-acb8d35e0a34 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.188303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970dfd8-617b-422a-b80c-acb8d35e0a34 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.188747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970dfd8-617b-422a-b80c-acb8d35e0a34 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.190188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 241/464] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:45.196114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.196616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.197114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.219264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:45.220932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:45.229714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e245c-338a-4acf-988c-21ee6fafc76d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.272475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.273456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.273910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.274355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.285108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.287070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:45.304026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:45.305165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:45.306388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:45.306388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:45.306388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:45.310031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 224/465] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:45.311038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.311755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 242/466] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:45.313145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.378091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.399513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.444691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e4052-98a1-4b10-a41e-3bd7e814406b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.469326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a57af-eaa9-40c4-a5f3-fc106e384266 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.506354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.507519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.508312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.509095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.510052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.511889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.512859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.513464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.513744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.514009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.514646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:45.514943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.516294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.538334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 243/467] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:45.538334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.551819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 225/468] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:45 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:45.561029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.697327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19a1be-b392-432a-860f-dc48e49b0540 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.714493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.745929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:45.748882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.749995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.750270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.750730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.753303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ed395-529f-4a55-a60c-ebb61a0c148c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:45.768922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.770703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:45.794265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:45.795248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:45.796122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:45.796122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:45.796122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:45.796122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 244/469] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:45.796577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.798456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:45.799197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:45.799996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:45.800364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:45.802172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:45.803667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:45.835141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 226/470] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:45 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:45.836182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:45.965924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559647e-4eb6-4759-a526-be0aab17390d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.014916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ac761-7a78-4447-aa6d-48a1854c2d53 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.017057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.017916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.019346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.019555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.037086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.038802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f1c19392-d13a-4ced-b58f-9af51ae56647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:46.064316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:46.065427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:46.066288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:46.066288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:46.066288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:46.069203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 245/471] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:46.070667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff68d-0eb1-4d2d-add0-2bd14b61a946 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.071147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff68d-0eb1-4d2d-add0-2bd14b61a946 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.071616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff68d-0eb1-4d2d-add0-2bd14b61a946 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.073308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 246/472] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:46.075143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff68d-0eb1-4d2d-add0-2bd14b61a946 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:46.076732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.077409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.077689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.077961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.078619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:46.078924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.080336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6716b-2dba-49bb-bfb6-8d2ba7ec319f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.095381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:46.109267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 227/473] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:46.111290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.111795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.112266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.134652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:46.137172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:46.151148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:46.200957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff68d-0eb1-4d2d-add0-2bd14b61a946 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.228062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 228/474] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:46.229728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:46.240799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.241679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.242095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.242502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.243491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:46.243953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.245618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.261412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 247/475] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:46.267796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:46.352704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48187990-334c-4c12-81b8-24d8aea9f61b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.373075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:46.394238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.394862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.395281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.395820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.396566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.398035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.402058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d874a-51a7-4736-9135-1e59421f16b7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.422921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:46.430510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 229/476] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:46 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:46.467434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.468048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.468327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.468602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.469370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.470812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.512121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 248/477] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:46 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:46.617299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:46.743502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73002b-3329-45f3-b5b8-2d7f87f8c964 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.780204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.780841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.781115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.781387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.782060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:46.783441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:46.794991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.sql.core [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:30:46.794991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:30:46.794991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [parameters: {'id': '1a2332dcf023451da8d51646a961b734', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:30:46.794991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81677) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 31 10:30:46.814829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:30:46.815768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application yield resource Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise self.value Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application session.commit() Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:30:46.817382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:30:46.819410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:30:46.821251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:30:46.823104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [parameters: {'id': '1a2332dcf023451da8d51646a961b734', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:46.826988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:30:46.828983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:46.830959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 230/478] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 31 10:30:46 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:46.832125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:46.938375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401b19-d8ee-4bf7-90fc-b868bcf24c34 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:46.970430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:46.979235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:46.980060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:46.980539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:46.980837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:46.995800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5476d2ce-fc5a-4de1-9d10-9b107b2a702c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:47.001129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:47.002052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:47.002864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 249/479] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:30:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:47.008437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:47.095342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:47.164012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a21226-d50f-452a-93cc-6ac33c2dc8fe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:47.215376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:47.216340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:47.216908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:47.217386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:47.218329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:47.218835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:47.220430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9ea00-6ee2-4a91-95a0-a4c56085a68c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:47.230351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 231/480] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:47.992416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb78ec-5ac9-47a1-9b34-d735c723ea48 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:47.992960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb78ec-5ac9-47a1-9b34-d735c723ea48 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:47.993064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb78ec-5ac9-47a1-9b34-d735c723ea48 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:47.994556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 250/481] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:47.999978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.000274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.000555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.025776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:48.027012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:48.114910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed8f0-69fa-441d-8fcf-96600e9ad852 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.115234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed8f0-69fa-441d-8fcf-96600e9ad852 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.115462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaed8f0-69fa-441d-8fcf-96600e9ad852 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.116804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 251/482] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:48.123063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.123348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.123617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.140064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 232/483] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:48.149439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:48.150678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:48.240344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 252/484] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:48.461685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:48.531273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:48.593284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892ca0-f2c8-492b-8a47-000ced5c565f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:48.617838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:48.637121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:48.638131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.638608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.639075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.656263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:48.664857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:48.665776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:48.666595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:48.672227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 233/485] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:48.677633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:48.783057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1596266-dcc2-4221-918e-f2dc67eb3395 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:48.832334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:48.855082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:48.855722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.856089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.856389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.873975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813385-e469-4f80-9b2b-c8a177d2297a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:48.878999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:48.888857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:48.889794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:48.890620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:48.891791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 253/486] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:48.899854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:48.913786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:48.947800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:48.948408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.948685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.948984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.949648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:48.949950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:48.951337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfc58-2fda-426a-8244-fc351bafe613 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:48.967905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 234/487] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:48.969206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f07f-5403-4a33-bc76-d710e6e00472 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:48.969493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f07f-5403-4a33-bc76-d710e6e00472 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:48.969771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301f07f-5403-4a33-bc76-d710e6e00472 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:48.971540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 235/488] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:48.974196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301f07f-5403-4a33-bc76-d710e6e00472 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.054373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1056b34-e2ec-4b43-9e31-5299a808114c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.092451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.092652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301f07f-5403-4a33-bc76-d710e6e00472 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.093080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.093551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.093970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.094839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:49.095345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.096892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120101ee-b867-4ba9-8e6c-0ca79557a93e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.106285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 254/489] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:49.107780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24debd-fc55-4fe7-b88b-111e9347892d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.108208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24debd-fc55-4fe7-b88b-111e9347892d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.108679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24debd-fc55-4fe7-b88b-111e9347892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.131436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5d24debd-fc55-4fe7-b88b-111e9347892d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:49.133132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5d24debd-fc55-4fe7-b88b-111e9347892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:49.138198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.138838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.139119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.139390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.152103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.153590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:49.169808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:49.170744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:49.171612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:49.171612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:49.171612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:49.171612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 236/490] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:49.171842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.180956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.208595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 255/491] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2224-9d1a-4909-ac7a-5cebeac87061 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2224-9d1a-4909-ac7a-5cebeac87061 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2224-9d1a-4909-ac7a-5cebeac87061 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 256/492] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:49.214877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2224-9d1a-4909-ac7a-5cebeac87061 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.286689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d99151-fc0e-424b-ae63-7232e2537769 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.323046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.323721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.323962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.324281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.325339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2224-9d1a-4909-ac7a-5cebeac87061 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.335472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.337031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2c3da676-3c3c-4dc0-b0c4-e5355b851f82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:49.351810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:49.352946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:49.353796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:49.353796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:49.353796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:49.354787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 237/493] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:49.356013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.356294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.356560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.361663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.362273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.362552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.362823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.364063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:49.364455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.365966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.378574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:49.380751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:49.383503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 257/494] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:49.385098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.419860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.460988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 238/495] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:49.462177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.489714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.491192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eba4a2-9ead-42e4-af1a-84cb8deee146 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.534574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.536506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.536959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.537304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.538020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:49.538584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.540884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.562557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 258/496] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:49.563486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.602438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6b274-9ab0-4992-83ec-87050a09d768 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.651519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.652161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.652439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.652714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.663123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.665231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.674224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.682547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f079847-31a6-49a1-9fba-ea068df994e7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:49.684611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:49.685529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:30:49.686440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:49.687347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 239/497] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:49.687918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.725652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.726279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.726555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.726897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.740274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:49.745575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:49.747706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 259/498] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:49.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.778232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.813478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2597-c66c-4b80-9c5d-63bdb5673a83 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.850286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.850908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.851186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.851457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.858877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.860324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.865829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f902f9-a03c-4730-9577-9537e7530598 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:49.872258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:49.873318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 240/499] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:49.875265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.904267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:49.904889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:49.905161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:49.905423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:49.906140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:49.906441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:49.907851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:49.947829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 260/500] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:49.948925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:49.964160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:49.977703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ea56-184f-4cb4-9a27-f3e1f3b0c266 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.007302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.012620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.013246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.013530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.013803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.014462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:50.014768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.016146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7532a-984c-4de6-86ae-242dde189401 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.024462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 241/501] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:50.025664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6e91-f89b-41e2-9970-3655e5912e93 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.025956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6e91-f89b-41e2-9970-3655e5912e93 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.026233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf6e91-f89b-41e2-9970-3655e5912e93 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.027508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 242/502] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:50.028274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf6e91-f89b-41e2-9970-3655e5912e93 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.055984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967896a-86a4-4c88-ac3d-7ef0b1b3760a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.090599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.091312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.091649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.091980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.101875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:50.106610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:50.107553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:50.108440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 261/503] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:50.109185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.135198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf6e91-f89b-41e2-9970-3655e5912e93 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.168532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.169163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.169442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.169712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.170434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:50.170736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.172174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.177574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.207153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71373c7-12e6-4815-a372-f3e066c87725 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.210337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 243/504] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:50.211184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.243972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.244565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.244874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.245143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.264479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.311637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.311851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2a1a-96a0-4160-8187-8985148dd5f9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.313118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.346914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.347531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.347900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.348186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.358853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.360418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b6cdfc9f-a8bf-4dc3-8c99-c29f786b20fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:50.374733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:50.375694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:50.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:50.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:50.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 244/505] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:50.377497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.377497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.377671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.381548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.397234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:50.398407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:50.412636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 262/506] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:50.413509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.471760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 245/507] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:50.472680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.511727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d95f-452a-4167-b888-9e2db8463631 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.517509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.548579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.549223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.549495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.549762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.550411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:50.550706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.552097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.560357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 263/508] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:50.561643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.594071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd47798-1699-4901-8a1a-eeffbe47ecca None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.599508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.633790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.634824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.635746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.636210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.669728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a353-4e29-4c05-9f17-7c566b59b9ea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.709231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.709879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.710150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.710420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.710577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.711047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:50.711344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.712036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.712709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.729432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 264/509] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:50.729432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.751254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.819210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.822993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 246/510] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:50.823837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.830051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce25d-b79d-42d3-aa33-2bedb83ed272 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.865155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.866009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.866291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.866587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.876605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.878201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:50.892997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:50.893976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:50.895177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:50.895177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.895177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:50.895177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 265/511] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:50.895673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.921639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fd00b-efdc-4df0-bf0e-d8d6e968be6a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:50.956448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:50.957660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:50.958166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:50.958399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:50.960290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:50.969062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:50.970521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:50.985289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:50.986291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:50.987583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:50.987583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:50.987583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:50.987583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 247/512] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:50.987583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:50.999765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7715725-4a9f-44c7-9100-6fc9c17460e1 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.033335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.033956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.034233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.034500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.043241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.044877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:51.059954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:51.061344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 266/513] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:51.062231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.070718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.097473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dffad-2824-48c0-af7e-1a92dc4ea0d2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.131484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.132098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.132369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.132633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.142976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.144624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:51.159768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:51.161335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:51.162192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:51.162192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:51.162192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:51.162192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 248/514] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:51.162425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.169054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9213d-f01f-4afb-a997-3969241e6131 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.203662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.204255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.204391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.204536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.204833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.216953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.218507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:51.233299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:51.234376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:51.235439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:51.235439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:51.235439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:51.235439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 267/515] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:51.235439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.272083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b092d81-6983-4ab7-9053-23e35b8ee424 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.291863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.306175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.306785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.307066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.307341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.308008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:51.308313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.309738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.321535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 249/516] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:51.322530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.337884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc419-cc59-46ac-afb3-f11b27ba173d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.371740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.372344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.372625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.372929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.373575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:51.373874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.375245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.386630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 268/517] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:51.387422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.421318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.424841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ffc4-679a-4f99-8a77-73281260dc6a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.459105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.459707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.459991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.460272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.461035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:51.461344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.462798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.480744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 250/518] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:51.481655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.490325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095a372-02e9-4ee6-8682-bc4959fc5b28 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.507487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.525461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.526057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.526333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.526602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.527238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:51.527538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.528939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.541085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 269/519] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:51.541782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.589437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff2ea4-ae44-4567-80bd-fb5b66683943 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.623100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.623707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.623985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.624255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.624923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:51.625224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.626608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.637649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 251/520] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:51.637956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba65b-5df0-49a1-b769-08b48da35635 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.638440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.659671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.672725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.673311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.673585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.673856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.680303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.681779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:51.694147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:51.695146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:51.696121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 270/521] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:51.700791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.741945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.745288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60171344-4904-4a0e-9e3c-7a865fd21b5e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.781241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.781875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.782155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.782431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.790570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.792034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:51.803641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:51.804587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 252/522] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:51.805509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:51.811884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b7a1-63cc-4086-9971-90175ce35ff8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.845377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.845971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.846249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.846522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.882185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.905584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169e259-5209-4208-bece-b7dabaff36dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:51.913317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.914764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.938157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:51.938694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:51.938973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:51.939244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:51.939882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:51.941339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:51.952220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:51.964232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 253/523] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:30:51 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:30:51.965092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.032586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 271/524] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:52.033607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.094259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c3e87-e29d-4317-a042-2c739e33fa06 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.130141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.137179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.137956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.138973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.138973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.148368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.149891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.156801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5a85c-e31e-421c-9b0b-7e310cbbe816 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:52.162997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:52.164029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 254/525] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:52.165292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.199140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.199659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.199933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.200205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.200920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.201226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.202739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.215459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.223526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 272/526] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.225005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.283821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce9f53-9407-433a-9e31-7d938fbbe318 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.320125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.320864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.321213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.321549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.322346 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.322752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.324291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.334325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18720e-52e7-4b31-9b95-1f069cbadde4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.347874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 255/527] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.347874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.378960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.380378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.380726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.381086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.391352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.392942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.402038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:52.410377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:52.411412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:52.412273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:52.412273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:52.412273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:52.412273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 273/528] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:52.412497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.462015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab43f3a-b638-41bd-b9c4-e2b8a556190b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.470385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.497307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.498053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.498443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.498807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.499582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.500047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.501610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.524720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 256/529] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.524720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.533336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a91e-d6a1-4e0c-b908-1704e22e80e6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.572187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.572854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.573135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.573406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.574138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=7089e9cdf205484b96a23fe75805d0d4) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.574442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.575868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.592790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 274/530] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/role_assignments?user.id=7089e9cdf205484b96a23fe75805d0d4&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.592790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.644328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7409-bb34-4ac6-8e45-913a72459532 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.658692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.696444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.697314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.697667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.697941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.714312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a04ba4-939f-4e51-8eaa-c7df34dcecee None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.734359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.757715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.758487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.758856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.759226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.759966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.760361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.761864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.776071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 275/531] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.777071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.793970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.795643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.877613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289ff6d-ddf8-4faf-a2c9-a6d704528e51 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:52.911811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 257/532] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:52.912784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.913599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:52.914304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:52.914671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:52.915036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:52.915942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:52.916279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:52.917912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:52.923955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 276/533] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:52.924880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:52.925506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:52.970866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.039455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e85a0-c7b0-4d54-8453-600585261aab None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.077913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.078716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.078989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.079256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.092038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.095218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.101930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c7d33-f188-4e01-a13e-2c29f3eb2c31 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:53.124784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:53.125785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:53.126683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:53.126683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:53.126683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:53.128401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 277/534] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:53.136779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.185528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.186448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.186874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.187284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.200096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.201130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:53.239302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:53.240186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:53.241460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:53.252975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 258/535] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:53.257745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.279640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.293306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2b98-0d0b-4cbe-a5e2-6bc5ea68ada3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.331972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.332979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.333473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.334258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.335235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:53.335762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.337635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.352228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 278/536] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:53.359928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.465150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.481562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ebe5f-6223-49d5-a570-9ecede8ada3b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.521244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.522350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.522872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.523354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.531507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.533269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:53.545300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:53.546222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:53.547075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:53.549449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 279/537] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:53.551714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2102ae6-27be-4faa-851e-1df82d13b8b7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.555458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.576434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.619509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.621440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.624635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.625148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.626045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:53.626547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.628273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.653647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 259/538] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:53.656133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.744744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec324-0d98-430f-94f6-70dfcf64fd40 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.813660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.814271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.814549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.814820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.815511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:53.815877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.818732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.843836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 280/539] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:53.849729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:53.853588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865199ea-4d23-40e1-b7f1-17f9b3c58c8c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:53.927529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.936962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:53.939656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:53.940271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:53.940552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:53.940850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:53.943607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=252058d963a641a68e526a016ff50031) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:53.943928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:53.948643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ed0ec-4d92-439b-849d-3a5e631d2f22 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:53.958235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 260/540] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/role_assignments?user.id=252058d963a641a68e526a016ff50031&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:53.980382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3216a-9006-426f-b6b8-5d7d69179707 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:54.018433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178bcbd-7d48-4597-b0b8-91a759b6c58a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.018736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178bcbd-7d48-4597-b0b8-91a759b6c58a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.018987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178bcbd-7d48-4597-b0b8-91a759b6c58a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.020940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 261/541] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:30:54.029877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3beb0-526e-4993-989c-2c23b7905a61 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.030172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3beb0-526e-4993-989c-2c23b7905a61 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.030539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3beb0-526e-4993-989c-2c23b7905a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.032637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:54.033272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.033554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.033823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.034549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=f0ea57d0513345ab8a0910ac780d7b32) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:54.034855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:54.038122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:54.045781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 281/542] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:53 2022] GET /identity/v3/role_assignments?user.id=f0ea57d0513345ab8a0910ac780d7b32&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:54.067492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-34d3beb0-526e-4993-989c-2c23b7905a61 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:54.068646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-34d3beb0-526e-4993-989c-2c23b7905a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:54.169887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 262/543] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:54.588577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:54.692986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ea3e-dd1a-4769-aebe-0145b26beb93 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.693992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ea3e-dd1a-4769-aebe-0145b26beb93 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.694474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1ea3e-dd1a-4769-aebe-0145b26beb93 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.696310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 263/544] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:54.701678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.702192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.702658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.724614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b507d-acf5-41a0-9a6c-dae9749d9652 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:54.729733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:54.731154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:54.764692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:54.765348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:54.765625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:54.765898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:54.769075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:54.782478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:54.791204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:54.792158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:54.793006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:54.796843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 282/545] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:54.797997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:54.891922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 264/546] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:30:54.979560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe38d70-135c-4cb5-a91a-9b7fb4fec433 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.026990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.027593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.027871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.028142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.028900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:55.029204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.030599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.048076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 283/547] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:55.055508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.123687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:55.175109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d8a11-062b-47c0-945d-319d0fdb5d04 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.217831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.218825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.219314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.219858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.232041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.233915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a97bb493-7ee4-4172-babf-9e34f77bc729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:55.252724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:55.253798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:55.254847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:55.254847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:55.254847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:55.261162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 265/548] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:55.263121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.322494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:55.368294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee2ae1-201e-4290-9da1-f61a01e9d7da None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.368938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee2ae1-201e-4290-9da1-f61a01e9d7da None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.369516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee2ae1-201e-4290-9da1-f61a01e9d7da None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.371068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 266/549] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:55.377712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.377996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.378272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.389378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6f34e-86f3-4f01-bbe3-43e4b48f4c60 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.417013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:55.418215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:55.434149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.434988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.434988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.435262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.435845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:55.436154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.437561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.454916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 284/550] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:55.454916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.508260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 267/551] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:55.509555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.545455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:55.609170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f89dc-952d-4d83-b243-9c3903588a48 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.617987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cd4e1-17cc-4756-bd9d-98e84379f2af None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.654589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.655224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.655506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.655780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.657088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:55.664420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.666084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:55.679183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:55.680491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:30:55.681516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:55.685023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 268/552] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:55.686136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.699765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.700565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.700938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.701339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.728464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:55.733466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:55.734569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:55.735411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:55.741193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 285/553] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:55.748273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.796364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:55.804397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a0562-45b8-48a5-92dc-5022d9fa3099 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.864522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.865552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.866037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.866512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.867447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:55.867980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.869656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.875525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c86ab5-9fea-4218-b97e-7ca63af8996e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:55.894920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 269/554] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:55.894920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:55.926896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:55.928141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:55.928531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:55.929075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:55.929975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:55.930449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:55.932930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:55.944725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 286/555] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:30:55.946258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.009664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.016943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4c5da-243a-4c99-b942-5c332fd0d58f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.067775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.068876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.069258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.069631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.080176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80b6c-b7f5-4db9-9ca4-2f16ab140089 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.085843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:56.091388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:56.092325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:56.093194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:56.096830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 270/556] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:56.098443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.118479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.138766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.139398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.139679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.139951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.219918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1e55-c0a4-46e3-9e38-cc2391dcbaee None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.227164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.228897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c94cc-09ce-4a15-b309-18fd1b2dfb65 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.256318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.256971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.257243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.257511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.268347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.270050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.271003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:56.287137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:56.288135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:56.289075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:56.289075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.289075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:56.289075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 271/557] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:56.289075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.341556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 287/558] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:30:56.343330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834495c-41e2-4e6c-9ab8-eef76f22f407 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.343613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834495c-41e2-4e6c-9ab8-eef76f22f407 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.343889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834495c-41e2-4e6c-9ab8-eef76f22f407 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.351464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 288/559] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:56.351464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834495c-41e2-4e6c-9ab8-eef76f22f407 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.370814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.411850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397ac5f-ae71-4f1c-a917-aef3021c8b4b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.448118 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.448725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.449030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.449302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.449961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:56.450422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.451802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.460211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 272/560] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:56.460950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.469343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834495c-41e2-4e6c-9ab8-eef76f22f407 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.504258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.504809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.505089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.505357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.505990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:56.506290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.507649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832e44c-589f-40a5-9659-23e151766f92 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.514088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.520915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 289/561] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:56.522337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.522620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.522892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.540705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:56.541935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:56.568163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39a5f-5395-4562-bbca-7580d10971ab None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.593492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.603195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.603821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.604097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.604368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.608795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 290/562] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:56.609516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.615665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.617145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b1914280-d926-4444-8ebd-b2c23745d13f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:56.644224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:56.646106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:56.647607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:56.647607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.647607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:56.647607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 273/563] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:56.647925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af828-2323-44e3-aee2-65e6d7a16d03 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.648193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af828-2323-44e3-aee2-65e6d7a16d03 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.648466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90af828-2323-44e3-aee2-65e6d7a16d03 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.649962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 274/564] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:30:56.650674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90af828-2323-44e3-aee2-65e6d7a16d03 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.728769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18c730-fdb4-41be-ad89-abfe5342d9c4 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.755649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.761198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90af828-2323-44e3-aee2-65e6d7a16d03 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.765286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.765909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.766184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.766451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.777601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.779037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:56.794564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:56.795538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:56.796436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:56.796436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:56.796436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:56.796436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 291/565] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:56.796436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.804044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.805651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.805651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.805896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.816573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.818468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-cb39d259-37b5-4be6-8570-8486733dc0fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:56.834944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:56.835852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:30:56.836822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:56.842602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 275/566] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:56.842602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.842602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.842602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.860740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:30:56.861954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:30:56.896493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:56.906319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca61d3-72d3-414a-bcef-b627b6936acb None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:56.929280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 276/567] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:30:56.930292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.939446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:56.940034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:56.940306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:56.940572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:56.941259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:56.941554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:56.942929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:56.954324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 292/568] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:56.955126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:56.999711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.051218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208b50-b0bd-411e-8131-fbf1322cd293 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.065695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cded97-af89-41fc-b959-eb4e9784e445 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.086449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.087185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.087573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.087947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.088599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.088931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.090321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.102448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 277/569] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.103237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.111430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.112253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.112671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.113128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.114177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.114510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.115943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.134886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.135458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 293/570] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:30:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.136311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.212030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da322e2-bd15-41da-8899-84c1178b6a94 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.245903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.249372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.250007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.250285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.250375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d4892-f46c-4549-bad0-003070bac765 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.250558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.261481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:57.266687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:57.267747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 278/571] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:57.268637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.290704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.291333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.291606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.291872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.298582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.300013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:57.311565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:57.312491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 294/572] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:57.313448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.363863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.374944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b892d-b289-4228-bf8b-fca66fc3a4de None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.410400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.411021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.411296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.411566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.415941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0861ff-1042-4965-82df-ecfb352741ad None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.419721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.421198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:57.432510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:57.433675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 279/573] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:57.434845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.452649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.453296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.453569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.453839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.464106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.465567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:57.479313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:57.480340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:57.481656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:57.481656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:57.481656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:57.481656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 295/574] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:57.481656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.493936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.539725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b6765-b0b6-431d-9511-cca0b494e052 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.573856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.574406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.574685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.574961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.581021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3accd-eba7-4a40-b3cf-13cf7f69d92d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.585225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:30:57.590510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:57.591604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 280/575] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:57.592483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.606589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.617468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.618056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.618353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.618619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.619263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.619552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.620952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.629517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 296/576] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.630322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.697577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3ef18-e7d0-4381-9c17-0bfa9a680458 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.702290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.733579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adae47-c83f-460e-bf2e-b60fcda938df None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.733877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.734485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.734780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.735033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.735712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.736016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.737486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.751368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 281/577] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.752180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.771623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.772262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.772538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.772840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.773567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.773873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.775290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.796701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 297/578] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.798027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.823535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.854935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00d70-d143-447d-b19b-121fc5aaf80e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.888909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.889626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.889905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.890178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.890812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.891111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.892522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.894755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2c607-6326-4708-a113-b4e5d05ee3e6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:57.903842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 282/579] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.904637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:57.924381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:57.930598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:57.931199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:57.931480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:57.931750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:57.932406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:57.932709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:57.934097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:57.942392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 298/580] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:57.943190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.007309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3c6a5-a40a-4f54-a223-f920e808ef4b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.036972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.042568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.043073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7272875-3aff-4a1a-be40-1af165b013ea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.043232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.043517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.043782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.054324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.055782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:58.070423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.071752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:58.072655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:58.072655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.072655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:58.072655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 283/581] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.072655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.081421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.082074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.082346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.082613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.083834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=c051c9e64b2b4d16958cf716d3f6ff36) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:58.084131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.085552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.090794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 299/582] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:30:57 2022] GET /identity/v3/role_assignments?user.id=c051c9e64b2b4d16958cf716d3f6ff36&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:58.091554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.168737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.190080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b6179-ea48-4f93-999f-8b5d6894b1d4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.218503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeaf853-7123-4120-a7f5-9ae37796c2b6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.229852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.230486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.230766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.231482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.243675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.256782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.256964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.256964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.256964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.257242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:58.261724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.262650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:58.263553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:58.263553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.263553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:58.265247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.266705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.267644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 284/583] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.268479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:58.282549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.283524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:58.284443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 300/584] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.285066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.309204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.379689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d2396-ab7f-489a-8876-7f5ca7a01906 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.400387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effd92-942e-4036-941c-601e05d622c1 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.416034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.417046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.417559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.417891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.418017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.431161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.432566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.437575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.438170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.438442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.438707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.439340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:58.439642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.441116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:58.449165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.450158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:58.451067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:58.451067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:58.451067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:58.456407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 285/585] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.456407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.457198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 301/586] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:58.457198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.552801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.560630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbda188-3965-434e-8d93-ca078c17404d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.570264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb7fc6-24aa-4d8e-aba3-6712943f41e5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.598577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.599176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.599531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.599731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.600392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:58.600896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.602172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.606147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.606753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.607033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.607304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.607944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:58.608246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.610114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.618432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 302/587] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:58.618432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.624853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 286/588] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:58.625675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.659902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.731631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bce5f-8e7e-41c1-ac37-894574081fa3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.731980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1d713-fef1-4b45-86ee-33e448741dea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.766968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.767595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.767870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.768141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.769025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.770594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.771038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.771314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.772073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:58.772378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.773770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.776328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.777781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.790028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 303/589] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:58.790028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:58.793326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.794357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:30:58.795308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:58.801386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 287/590] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.801386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.811248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.894072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:58.901010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109504b-d83c-44c0-97dc-12e7f5d2cc40 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.908744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53230180-068f-4012-b6d4-c1ad16371949 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:58.938206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.938863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.939139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.939406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/7089e9cdf205484b96a23fe75805d0d4/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.945382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:58.946011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:58.946292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:58.946562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:58.953526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.954651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=7089e9cdf205484b96a23fe75805d0d4, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:58.954984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.956074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:58.967100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:58.968182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 288/591] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:58.969105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:58.982558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 304/592] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:58 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/7089e9cdf205484b96a23fe75805d0d4/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:58.982558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.052528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.099939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2004a9-0e2f-435e-b109-9e6d40632b19 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.101434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0093-d79e-4d7b-8e00-31bcc250d879 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.145932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.146609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.146909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.147182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.147915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:59.148224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.149766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.153445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.154077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.154354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.154624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.164046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.165644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.171802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 305/593] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:59.172687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.176911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:30:59.181328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:59.182298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:59.183247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 289/594] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:30:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:59.183839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.296128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace32e1-ce58-4656-83bd-0ef5ee6c86bf None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.311658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591021a3-8d41-4bfd-a28b-c25aa08dcb07 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.337921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.338532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.338808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.339080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.339776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.339891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:59.340067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.341953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.351080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.351940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.352366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.352791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.360207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 306/595] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:59.360207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.370246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.372012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:59.387438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:59.388630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:59.389596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:59.389596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:59.389596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:59.391026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 290/596] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:59.391905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.428793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.469196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f83e-978d-4a03-babd-02731a275dd2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.500172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665aff-01e7-4f73-831b-097e3286d77a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.507144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.507750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.508028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.508459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.509233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:59.509865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.510952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.533526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 307/597] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:59.533526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.543470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.544429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.544942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.545354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.561927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=211155364dfd4a60bc13efa3c7d7fa98, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.563577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.584467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 291/598] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:30:59 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:30:59.585888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.640199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcab6-3752-4ef8-885d-351c3f1c786d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.642954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.673630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:30:59.679260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.680180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.680352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.680628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.681368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:30:59.681729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.686122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.701028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 308/599] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:30:59.702293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.772644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4860458-657f-4a87-b188-54b7194a00dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.829878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.830886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.831406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.832523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.850794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842430ad-b984-4c6d-86ec-f89c504364a9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:30:59.855297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.856976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.899714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:30:59.900359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:30:59.900637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:30:59.900937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:30:59.902014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:59.902915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:30:59.903808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:30:59.903808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:30:59.903808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:30:59.905194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 292/600] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:30:59.911406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.916492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:30:59.917907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:30:59.932336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:30:59.933402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:30:59.934454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 309/601] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:30:59.939245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:30:59.992160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:00.025151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:00.038279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f9567-ca30-4fc5-a392-0e9327aee2a4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.063491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd5c50-3d9b-46d4-be0b-ee8fad05b3ee None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.073928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.074681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.075057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.075503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.076171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:00.076594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.078134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.091856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 293/602] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:00.098273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:00.117149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.118124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.118567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.119022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.119886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:00.120361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.121991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3321a-f6bd-4a62-80eb-d57540cc7533 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.140065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 310/603] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:00.141657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75637-d68a-42fe-8c3d-a48eabd9797a None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.142100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75637-d68a-42fe-8c3d-a48eabd9797a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.142529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd75637-d68a-42fe-8c3d-a48eabd9797a None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.144171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 311/604] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:00.147930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75637-d68a-42fe-8c3d-a48eabd9797a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:00.240026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a088-bb75-450e-9d06-7730ee219f8d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.257564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd75637-d68a-42fe-8c3d-a48eabd9797a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.259442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:00.281101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.281740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.282091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.282434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.290377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.292027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.295237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:00.296500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.297483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.297935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.298366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/252058d963a641a68e526a016ff50031/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6579a0f0-60a8-4fbe-a098-13ed528ea48a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:00.306564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:00.307503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:00.308402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:00.312528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 294/605] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:00.313940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.314223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.314492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.317733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=252058d963a641a68e526a016ff50031, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.319386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.335269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:00.336473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:00.337388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 312/606] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:00 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/252058d963a641a68e526a016ff50031/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:00.338467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:00.502378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dcebc-9e19-4a6e-a693-013908707308 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.519622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 295/607] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:00.541271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.541881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.542159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.542431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.543128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:00.543434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.544875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.558171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 313/608] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:00.563938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:00.679542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80451-5964-4aa9-83e2-a0d68156c771 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:00.710739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:00.717106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:00.718633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:00.718927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:00.719202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/f0ea57d0513345ab8a0910ac780d7b32/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:00.735337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=f0ea57d0513345ab8a0910ac780d7b32, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:00.736815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6405-1863-4610-ae55-8506f2cf0dec None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:00.752833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 296/609] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:00 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/f0ea57d0513345ab8a0910ac780d7b32/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:00.981407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.007312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:01.067643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba820-dc2d-468c-a3bc-b73475278d37 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.068156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba820-dc2d-468c-a3bc-b73475278d37 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.068233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba820-dc2d-468c-a3bc-b73475278d37 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.069784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 297/610] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:01.079904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.080189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.080462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.103319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:01.104529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:01.125557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ee4e-f00e-46b3-9f47-211f5a087c08 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.168981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.169619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.169898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.170172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.184588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:01.190142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 298/611] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:01.190654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:01.192196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:01.193128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 314/612] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:01.199942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.321396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28417fba-2b19-4560-8c21-0bcf87b58c50 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.340814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:01.374290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.374900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.375177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.375493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.376151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:01.376448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:01.377852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:01.390165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 299/613] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:01.395953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.504027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:01.537714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6789-8f31-4dc1-831d-b72edcfaf6f2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.585908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.588005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.588639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.588999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.589271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.614416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:01.615884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:01.639133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:01.640162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:01.641099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:01.641099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:01.641099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:01.641688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 315/614] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:01.649844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.782163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d44605-61ce-41de-b123-c8da3e0275ac None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.817115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:01.827501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.828193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.828539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.828908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.829626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:01.830004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:01.831545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:01.838710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c230-dba0-429c-a835-b72b33532d12 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.849126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 316/615] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:01.851344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:01.952389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792efb0b-a148-4a95-9edd-68c5268e828e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:01.954765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.955402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.955674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.955939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.988123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:01.988957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:01.989286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:01.989559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:01.997036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:01.998530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:01.999498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a426c34f-335a-4bea-9d00-f43733e2bdcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:02.008387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:02.009709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:02.010766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 300/616] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:02.011615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:02.012641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:02.013814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:02.014473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95360b-34fb-4fc9-8c30-ebe97bff0738 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.014568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 317/617] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:02.015790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95360b-34fb-4fc9-8c30-ebe97bff0738 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.016096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95360b-34fb-4fc9-8c30-ebe97bff0738 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.017832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 301/618] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:02.017937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.021777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95360b-34fb-4fc9-8c30-ebe97bff0738 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.052085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.082398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.148940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689bcf2-2f4c-4ead-848f-5f1a90739a09 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.152045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95360b-34fb-4fc9-8c30-ebe97bff0738 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.191018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.192271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.192820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.193290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.194537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:02.195045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.195633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.196249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.196535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.196850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.197529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:02.197838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.198319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.199314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28db3b-b4f4-4179-8c47-e12857e41a96 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.210511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 302/619] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:02.212620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.212620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.213002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.223764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 318/620] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:02.225296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.239329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:02.240648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:02.321584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 303/621] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:02.322613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.343860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba92a-dfcd-47f5-824f-bed15386ec17 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.346053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.352580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.387720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.388868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.389403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.389924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.402005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.404232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:02.422169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:02.423375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:02.424531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:02.424531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:02.424531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:02.427779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 319/622] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:02.436048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.443281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ed45c-01fa-47fa-af7e-52663271b904 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.484296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.488876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.488876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.488876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.498141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.505646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:02.517647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:02.523546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:02.524550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:02.524550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:02.524550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:02.524550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 304/623] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:02.524550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.632322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739394-4f9a-41e3-ac11-6e50b67b493b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.662175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.679885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.680604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.680976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.681313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.682034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:02.682406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.683860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba35d-d279-491a-8007-f2a570c42d57 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.694975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c027d-a370-47cf-b97e-7c8f6c70ea90 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.697497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 320/624] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:02.698820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd5ae-8383-4d3e-a0f9-c3b35c101a76 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.699176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd5ae-8383-4d3e-a0f9-c3b35c101a76 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.699512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd5ae-8383-4d3e-a0f9-c3b35c101a76 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.704921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 321/625] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:02.705806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd5ae-8383-4d3e-a0f9-c3b35c101a76 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.724448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:02.744866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.745578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.745856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.746450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.747431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:02.749042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.750648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9fd6-ef62-4477-8e1e-1aebee35bc5a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.772919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 305/626] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:02.774242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.774529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.774806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.803200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:02.803200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:02.833624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd5ae-8383-4d3e-a0f9-c3b35c101a76 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:02.871033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:02.871672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:02.871953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:02.872225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:02.880993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:02.882446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:02.887018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 306/627] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:02.888157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:02.902684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:02.903911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:31:02.905138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:02.908512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 322/628] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:02.909602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:02.973031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.013794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd695179-8e67-45af-91a4-44d74e70763a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.021179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.046603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf24f-6406-4c82-8551-b9a269d20e0d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.054189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.055173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.055675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.056151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.068595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:03.074354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:03.076108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:03.077993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:03.081658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 307/629] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:03.083540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.087492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.088323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.088601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.089039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.101325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.103254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:03.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:03.121434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:03.122371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:03.124894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 323/630] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:03.125936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.228223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56196b-e95e-4e84-b41f-8a446e81e0f6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.244421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d11012-25b6-4439-8e6e-c4d77a13e2f2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.257769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.267016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.267624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.267905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.268181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.269097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:03.269498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.271584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.289086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.289976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 308/631] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:03.290381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.290810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.291093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.291573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.292312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:03.292686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.294203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.295915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.305726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 324/632] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:03.306738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.406991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a1f64-7eb9-4f6b-b70e-a865211af170 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.417158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acbf1f-1920-4ebe-bc69-f448ac4504be None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.446430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.447041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.447316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.447585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.448288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:03.448576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.450239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.457793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.458432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.458706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.458980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.466016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 309/633] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:03.466845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.475121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:03.480616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:03.482150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 325/634] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:03.483460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.522050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.541524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.576881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf933-8bcf-4e00-9625-7ae795a97647 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.585666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995790-2e10-4370-af76-e969ce7f161a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.609561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.610211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.610489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.610759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.620575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.621238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.621521 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.621790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.632860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.634317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-1e0f53cf-3aa6-463c-8f95-c5e00466025a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:03.648573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:03.649751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:03.650933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:03.650933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:03.650933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:03.650933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 326/635] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:03.651175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc119-2cc7-4274-a934-e38f02ecf3bf None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.651363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc119-2cc7-4274-a934-e38f02ecf3bf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.651635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc119-2cc7-4274-a934-e38f02ecf3bf None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.652997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 327/636] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:03.655392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cc119-2cc7-4274-a934-e38f02ecf3bf None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.680834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.682293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.726131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.755486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cc119-2cc7-4274-a934-e38f02ecf3bf None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.764036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.782037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 310/637] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:03.782872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.790114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.790774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.791047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.791314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/c051c9e64b2b4d16958cf716d3f6ff36/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.807387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=c051c9e64b2b4d16958cf716d3f6ff36, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.808846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.821203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 328/638] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:03 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/c051c9e64b2b4d16958cf716d3f6ff36/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:03.822007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:03.896519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131ff7b-54a8-40af-b850-813fc17109e7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.935816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:03.936581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.937020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.937386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.938179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:03.938576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:03.940051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcce651-2af8-460b-8471-6849d5e71094 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:03.954552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 311/639] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:03.954552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:03.954552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:03.954552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:03.960540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611da98-f62f-4058-9ee5-d904ba85bdff None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:03.968431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:03.976222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:03.977698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:04.002889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.003819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.004110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.004379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.005050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:04.005352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.006882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.018707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 329/640] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:04.019563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.045896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.058151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 312/641] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:04.059054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.163618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668536-ceeb-4bb3-9829-60f20086dab7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.169565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9124139-8c5f-4173-a1f2-2c0c4331785f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.199333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.200080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.200353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.200665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.211576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.213065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.214932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.215245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.216661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.217155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.217629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.232073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:04.233582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.234856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:04.235765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:04.235765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:04.235765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:04.235765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 313/642] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.236010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.236547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:04.253037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.254410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:04.255565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:04.255565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:04.255565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:04.256861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 330/643] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.258087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.340356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.365474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe707065-0fee-41a9-85e2-82a7b0d98dab None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.376505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda708b-a555-4773-ac9f-021b70edbc5e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.403072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.403817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.404093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.404420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.411047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.411636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.411909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.412176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.412832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:04.413130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.413345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.414486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.414851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.435222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 331/644] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:04.435222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:04.435521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.436598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 314/645] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.437963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.494775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.542233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d2106-8326-4eda-8ac1-0e836ee9fbfe None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.555426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6f15b-74ac-450d-bdb8-a8920a78c653 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.573273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.580472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.581213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.581563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.582136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.582587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:04.582890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.584358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.589588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.590208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.590483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.590752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.597474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 332/646] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:04.598338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.602749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:04.609583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.610550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 315/647] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.616423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.698878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca19cf-a8a4-4b59-9d0e-0309cbbf33b5 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.725625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfcb3f-f73d-411c-92b9-7241a4fd7acc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.734444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.735064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.735340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.735631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.736366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.744341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.745799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:04.757319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 333/648] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.759259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.770896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.771783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.772372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.772733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.773555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:04.774073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.775583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.795042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 316/649] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:04.795965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.819295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:04.881572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994346a-b77b-4f5a-aec8-0310c91b46c4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.906650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9a60-0b4e-4d18-a00b-48e80118c66a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:04.920196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.921055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.921329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.921595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.928922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.930379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:04.942470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:04.943394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 334/650] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:04.944314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.947347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:04.947958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:04.948239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:04.948564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:04.949264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:04.949561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:04.950927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:04.964675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 317/651] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:04.964675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:04.995116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.067039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d7a31-ffcb-45a5-b431-c22e9f7c164e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.079694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.099571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbd955-2fcd-4c19-9598-35178cfc88a2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.108773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.109501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.109886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.110520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.111187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:05.111594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.113970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.138280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 335/652] 10.222.0.70 () {56 vars in 1137 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:05.139346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.141704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.142431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.142712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.142997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.236911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.240004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.266972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923b1de-ec73-4d0e-87ab-681e52c12678 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.286354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.306840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.307682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.308144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.308560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.309448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:05.309924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.311486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.327244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 336/653] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:05.328277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.367391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.385217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 318/654] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:05.386404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.458957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d07cba-58c5-4f10-9941-bd99fd9f1075 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.497120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.497742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.498023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.498287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.501400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282cb7-1db5-4907-83fc-95c4d9716e8d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.509551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.511054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:05.527261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:05.528255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:05.529200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:05.529200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:05.529200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:05.529200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 337/655] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:05.529200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.537558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.548865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.549528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.549810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.550122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.618443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.629980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.631441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.638420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1386f4e-fb07-46f2-964d-296d6ffea285 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.671848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.672451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.672740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.673025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.673746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=7089e9cdf205484b96a23fe75805d0d4) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:05.674047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.676067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.682194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 338/656] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/role_assignments?user.id=7089e9cdf205484b96a23fe75805d0d4&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:05.682989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.759501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 319/657] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:05.760880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.794110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.838652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c3d0-fe28-457e-8b29-8f67db1fa6dc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.880593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.881203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.881475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.881748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.887530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f42c5d-68c7-49f3-ab8f-84dcff1038c3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:05.895274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.896751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.899419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:05.912398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:05.913430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:05.914343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:05.914343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:05.914343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:05.914343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 339/658] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:05.914569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:05.930134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:05.930739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.931012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.931271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.931910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:05.932210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:05.933620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0371fee-485a-4f1b-bfaa-4b8aab8438c6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:05.946957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 320/659] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:05.948211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ba6a-a8f7-4536-a68c-ddf32371911c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:05.948497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ba6a-a8f7-4536-a68c-ddf32371911c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:05.948794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ba6a-a8f7-4536-a68c-ddf32371911c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:05.954016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 321/660] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:05.954016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ba6a-a8f7-4536-a68c-ddf32371911c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.028221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f8e6f-5130-42d9-9440-a5af675f9f88 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.040078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.054426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ba6a-a8f7-4536-a68c-ddf32371911c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.066630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.067279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.067805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.067805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.078810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.080266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.090197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.090822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.091101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.091469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.092112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:06.092415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.093818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528008-852b-499e-8587-8f0290bde8bd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:06.094451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:06.095411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:06.096326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:06.096326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:06.096326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:06.096326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 340/661] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:06.096326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.116152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 322/662] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:06.117530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.117814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.118087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.136235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:06.137456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:06.147108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.202328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee26f15-b328-4313-a124-aebb0d91235c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.212793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 323/663] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:06.212793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.250415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.251202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.251647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.251980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.262169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.263680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:06.276638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:06.277939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:31:06.279108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:06.279877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 341/664] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:06.284234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.302424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.327212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0389-8e65-4ec8-b976-7ec395e958d5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.367421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.368082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.368366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.368639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.369313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:06.369636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.371162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.383664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 324/665] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:06.388845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.395430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be78082-e17d-4624-9b78-38d7bdc6c542 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.405233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.433158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.433846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.434123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.434394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.441988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.443615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:06.455943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:06.457918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:06.458977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:06.462523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 342/666] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:06.463508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.505048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5631-49da-4d06-9a9b-0eb960219e21 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.540638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.541275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.541555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.541831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.542558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:06.542863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.544284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.553563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.564906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 325/667] 10.222.0.70 () {56 vars in 1139 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:06.566634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.584943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c677db-ec1c-4b8b-b079-bd81a1998c79 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.619396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.620036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.620310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.620575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.627249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.629534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:06.640662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:06.641697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 343/668] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:06.643020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.674307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.681421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957ffa9-70da-4539-b55f-e71ab30452c8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.718142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.718769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.719051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.719327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.720014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:06.720318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.721791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.738557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 326/669] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:06.738557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.760221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb6402-2b25-4b11-9af8-db721fdd389e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.799191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.800675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.801251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.801702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.805374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.814038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:06.819593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:06.820547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:06.821424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 344/670] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:06.822124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.860767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d037f8-6a0a-4d0d-a535-68ecaaa2d280 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.906446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.907935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.908463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.909943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.919690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:06.934202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c001475-2e95-4079-ac50-4bd285ad7406 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:06.968542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:06.969166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:06.969441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:06.969711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:06.970402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:06.970704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.973324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:06.990913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 345/671] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:06.990913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:06.992547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:06.994064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.053528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.093458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f235-53af-4e2f-b7bc-9243f95dc9f4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.107103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 327/672] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:07.107103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.135508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.136112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.136401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.136653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.137403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:07.137709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.139122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.145758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 346/673] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:06 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:07.146393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.162853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.243621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f3fb-1c61-4b4c-a1da-c7481715f4d6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.274727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343a49-3bfb-4032-9610-fa6b1c7ce23e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.284044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.284800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.285086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.285351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.286477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:07.286477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.287691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.298582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 328/674] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:07.300843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.319249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.320143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.320585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.320893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.321619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=252058d963a641a68e526a016ff50031) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:07.321923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.322771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.323351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.334539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 347/675] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/role_assignments?user.id=252058d963a641a68e526a016ff50031&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:07.335972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.445131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.445348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8c89d-2f93-4f80-b303-066760ee5521 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.473228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c92d-9a66-4d03-92f3-3f675f8f4788 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.488504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.488504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.488504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.489093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.501379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.502849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.514467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.515099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.515378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.515650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:07.519415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:07.520654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:07.521596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:07.521596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:07.521596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:07.521596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 329/676] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:07.530401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.533207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.535468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:07.552390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:07.553447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:07.554776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:07.554776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:07.554776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:07.554776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 348/677] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:07.561515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.614705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.663714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1eaf-a777-45f8-b125-0370ac00468e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.682045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075ce5-81b4-402f-a2cd-4b8cd133507f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.710816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.711469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.711886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.712178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.712860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:07.713473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.715192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.724795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.726125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.727171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.727657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.728135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.733061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 330/678] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:07.733189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:07.733402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.734864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.739524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.760479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 349/679] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:07.766223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.882175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf692b-b923-4f8f-8492-5f42ffba7cb8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.882729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725e90f-103c-47a9-9769-f226f43c39f6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:07.913222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:07.919859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.920948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.921327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.921697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.922565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:07.923356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.923892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.924311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.930163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.931745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.933300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:07.935132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1806eaaf-e858-46f8-8f04-3c4abee650f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:07.944696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:07.945690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:07.946589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 331/680] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:07.947757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62148e-9cd4-4477-b808-1288abf7e9f5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.948036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62148e-9cd4-4477-b808-1288abf7e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.948302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62148e-9cd4-4477-b808-1288abf7e9f5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.949825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 332/681] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:07.952642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:07.953703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:07.954664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:07.956930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 350/682] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:07.958357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:07.958645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:07.958915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:07.960351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:07.978075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:07.979209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:08.018613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.059847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 333/683] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:31:08.060957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.082824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33a8a-c27d-47a0-b1a7-58a8052fbd45 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.141289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.142074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.142358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.142630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.143327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:08.143629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.145533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.174791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 351/684] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:08.183908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.186013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddcb34-65a6-4da4-a08c-66fe54716d6b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.210562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.229575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.230661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.231004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.231287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.232028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:08.232340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.233966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.261098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 334/685] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:08.263261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.380448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b183eb0-9422-4ece-8f5e-00b657aeb95d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.383908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fff45-ff9d-43d6-85a1-cb862efe1c76 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.390647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.418983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.419609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.419961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.420290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.421053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=f0ea57d0513345ab8a0910ac780d7b32) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:08.421358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.423029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.429367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.429973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.430253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.430553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 352/686] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/role_assignments?user.id=f0ea57d0513345ab8a0910ac780d7b32&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:08.431359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.432870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.545735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.596067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.597953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.637037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230c96c-3233-4c0a-b383-7dcdac077c0e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.683359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.684099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.684382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.684805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.697496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.698970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:08.716000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:08.718321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:08.720442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:08.720442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:08.720442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:08.720442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 353/687] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:08.723624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.741343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 335/688] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:31:08.749036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.758540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.850158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:08.874434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6a1fc-38fc-4743-a7bb-860490a37304 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.881440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c513d9f-c0f7-4fd6-9ea7-a7c61706097d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:08.916706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.917746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.918172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.918613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.919517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:08.919964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.921509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:08.936628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 354/689] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:08.942604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:08.959734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:08.960381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:08.960667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:08.961313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:08.997610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:08.999088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:09.028855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:09.030070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:09.031190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:09.031190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:09.031190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:09.037271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 336/690] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:09.038170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:09.041682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:09.061941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae840c93-0538-497d-8a92-e139499e6ade None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:09.104098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:09.105008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.105454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.105966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.106866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:09.108432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:09.133654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 355/691] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:31:08 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:09.231219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e85e3-2953-4b92-bde1-e012fb3e1670 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:09.267305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:09.273973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:09.274613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.274894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.275167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.275947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:09.276254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:09.277924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:09.293218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 337/692] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:09.298585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:09.413975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389451-50a6-49c0-a825-637e29b05d44 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:09.451544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:09.452544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.453055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.453646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.461265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:09.462744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:09.467136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-873ea611-21cf-49b6-95d8-dfc150c4e3df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:09.478050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:09.479015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:09.480048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:09.482677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 356/693] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:09.490316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:09.577336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b0060-7ba8-4417-8617-d426078fa6ae None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.577659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b0060-7ba8-4417-8617-d426078fa6ae None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.577886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b0060-7ba8-4417-8617-d426078fa6ae None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.579325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 357/694] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:09.585260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a229-f123-4040-bb19-50d8ab6f1125 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.585538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a229-f123-4040-bb19-50d8ab6f1125 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.585808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854a229-f123-4040-bb19-50d8ab6f1125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.613378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3854a229-f123-4040-bb19-50d8ab6f1125 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:09.614910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3854a229-f123-4040-bb19-50d8ab6f1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:09.641683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fb69b-f0d2-459c-b27d-25904582144a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:09.683035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:09.685890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.686392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.686860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.688243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:09.690335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:09.693751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:09.719775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 338/695] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:09.726275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:09.728005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 358/696] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:09.817674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d7328-8958-402f-bb87-1792df14d787 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.817964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d7328-8958-402f-bb87-1792df14d787 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.818225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d7328-8958-402f-bb87-1792df14d787 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.821808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 359/697] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:09.832925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:09.833465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:09.833931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:09.834196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:09.853224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:09.854557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:09.927293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 360/698] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:09.960642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21406b-bb64-4be2-9af9-a38126250fa4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.020103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.020718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.021020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.021288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.022009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=c051c9e64b2b4d16958cf716d3f6ff36) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:10.022315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.023752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.030238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 339/699] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:09 2022] GET /identity/v3/role_assignments?user.id=c051c9e64b2b4d16958cf716d3f6ff36&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:10.053356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.117617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:10.162441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e29a-e22c-45e3-b890-9c1a30dc4490 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.200647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.201376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.201695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.201970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.202560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.203937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:10.216115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:10.217293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:10.218287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 361/700] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:10.224193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.335998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.352101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03237-b505-43e6-91b4-bd3d5d26090f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.374791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:10.418259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.418869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.419148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.419418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.420049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:10.420380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.421859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.429376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 340/701] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:10.439489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.467516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b8af7-7185-45e6-800a-f4b953211f7d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.497215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:10.512206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.513126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.513584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.514025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.526900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:10.532547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:10.533670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:10.535206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:10.537992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 362/702] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:10.544154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.576876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e8e47-350e-454f-8f85-1072dffc00ae None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.620909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.621640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.621982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.622316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.623177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:10.623543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.625548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.633283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 341/703] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:10.669134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814315-b56c-4e78-a08b-573e1fa1e4b9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.709734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.710828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.711416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.711895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.712827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:10.713457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.715123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.726445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 363/704] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:10.732701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:10.794717 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:10.869328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbf4de-3e22-43cc-827c-ada58e9cd6e2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:10.912274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:10.912942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:10.913216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:10.913482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:10.924605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:10.926635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fe00a0df-81a6-48b2-bd2f-f6863d5b870d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:10.945765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:10.946760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:10.947648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:10.947648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:10.947648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:10.947648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 342/705] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:10.954737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.015163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:11.070285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0c97-cccf-4992-abc7-d089677b1821 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.070602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0c97-cccf-4992-abc7-d089677b1821 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.070821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0c97-cccf-4992-abc7-d089677b1821 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.072154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 343/706] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:11.077226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.077507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.077746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468acf7-b5bf-4052-bf0a-2666e8f8d41f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:11.077916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.116847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:11.117619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.117901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.118172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.118821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:11.119125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:11.120486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:11.126736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:11.128093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:11.151104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 364/707] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:11.156702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.256193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 344/708] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:31:11.303071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e520a-33b1-4340-bb9b-2f91e0160ea3 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:11.310726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:11.350087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:11.350739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.350970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.351239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.365538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:11.367355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:11.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:11.383584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:11.384618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:11.388167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 365/709] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:11.393089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.429056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:11.528145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d760b04-57a0-4fa4-b2a9-1cfb835ca9af None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:11.564037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:11.564576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.564884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.565164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.566289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:11.566603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:11.568074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:11.591448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 345/710] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:11.592860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.605819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.737953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43643254-1b1a-4f53-be90-3702d63c93b0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:11.777236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:11.814265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:11.814817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.815095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.816245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.818595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a45b1-34bf-44e6-9df8-2943dd918034 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:11.863769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:11.874230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:11.875576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.876309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.876815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] PATH_INFO: `/v3/services/network` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.877868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:11.880685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6b859ede-9485-40e2-8749-5698383f4672 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:11.897125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:11.898164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:11.899015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 346/711] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:11 2022] GET /identity/v3/services/network => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:11.899818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9b11-d066-4db9-83ce-2ffa6e931913 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:11.899818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9b11-d066-4db9-83ce-2ffa6e931913 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:11.900475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9b11-d066-4db9-83ce-2ffa6e931913 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:11.901509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 347/712] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:11.904222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d9b11-d066-4db9-83ce-2ffa6e931913 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:11.907397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:11.910298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ee63a-f09a-44c2-bf93-9a7bddf28515 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.021202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d9b11-d066-4db9-83ce-2ffa6e931913 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.036743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 366/713] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:12.038325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.038808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.039294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.058585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:12.058898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.059474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.059803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.060089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.060739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] RBAC: Adding query filter params (name=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:12.061114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.061883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:12.063139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.070545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 348/714] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:12.071422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.089230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.130484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.139533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 367/715] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:12.140746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.188145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573c83d-15ef-41c0-a23f-3ec2f0d8781c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.225236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.225946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.226229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.226506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.238481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.239996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.247424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde69d-1ee2-4928-8195-91f3e037945b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:12.255708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:12.256684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:12.257625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:12.257625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:12.257625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:12.257625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 349/716] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:12.262382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.288310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.289327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.289834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.290300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.291121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] RBAC: Adding query filter params (type=network) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:12.291616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.293205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.299250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 368/717] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:12.332074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.374323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9181f-e2ea-4c8c-b39d-ae7d51f62bdf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.412809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.413435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.413714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.413989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.414640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:12.414944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.416318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.429681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 350/718] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:12.435771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.489023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.563589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.605844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b399f5e-bf2f-44d1-b523-88dde2467c33 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.617306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f355da-58ab-40d7-957d-0688b2148727 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.629966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.660280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.660954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.661234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.661757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.668819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.670644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:12.683194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:12.684134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:12.685049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 369/719] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:12.690051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.690377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.690899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.691182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.691449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.719506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:12.728987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:12.729985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:12.730873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:12.735700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 351/720] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:12.744472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.855496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b0810-3b72-46c0-a689-66887b402bb8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.877074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:12.893493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.895087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.895466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.895741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.896455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:12.896773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.898323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10b2f-db4a-4a3b-b8e4-a6e01c2dc0eb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.901811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964b7dd-de6e-4146-b4d2-ff129621673f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:12.911765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 370/721] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:12.913167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902f208-a266-405c-886f-73341fa9e51d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.913447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902f208-a266-405c-886f-73341fa9e51d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.913716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902f208-a266-405c-886f-73341fa9e51d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.920341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 371/722] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:12.921342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902f208-a266-405c-886f-73341fa9e51d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:12.942796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:12.943502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.943868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.944238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.945173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:12.945543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:12.947147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd477c-8d38-4cab-9822-5f7baea353c7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:12.956673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 352/723] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:12.958001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:12.958451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:12.958790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:12.980031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:12.981267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:13.026621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.030724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902f208-a266-405c-886f-73341fa9e51d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.064792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 353/724] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:13.064792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.074702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.075328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.075607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.075911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.076639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:13.077023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.078409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31a8e-6e3d-4e27-9267-0c028b5178f2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.085534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 372/725] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:12 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:13.089661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a22e-6cd6-45c1-a8ee-a59e82213029 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.089958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a22e-6cd6-45c1-a8ee-a59e82213029 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.090246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560a22e-6cd6-45c1-a8ee-a59e82213029 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.098397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 373/726] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:13.099833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.100117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.100426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.139909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:13.141149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:13.233338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.264643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0776-c5a0-4aa2-8cae-9f186004e8a0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.283432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 374/727] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:13.303915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.304551 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.304887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.305166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.315889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.317577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:13.333231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:13.334178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:13.335072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:13.335072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:13.335072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:13.335072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 354/728] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:13.339944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.385445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.415696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.477498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63897fd4-b194-4f3e-a53d-128238ab2bc4 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.512939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.513591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.513872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.514139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.514780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:13.515079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.516460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.530875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 375/729] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:13.534648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.553026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eddc0-3b5a-4768-98ec-cf436ec0cf10 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.589128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.624178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.624885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.625121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.625394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.636741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:13.638420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0cedf-4f0c-4670-b315-62ee97b16265 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:13.642081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:13.643006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:13.644028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 355/730] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:13.645001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.673864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.674424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.675445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.675795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.684539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.686116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:13.698547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:13.699530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:13.700526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 376/731] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:13.705347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.743129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.767635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1d672-0436-4c25-84ea-917f8fd5917d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.810741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.811360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.811643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.811920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.812580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.814243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.822076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:13.833199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecd26b-a4dc-42d9-8ae5-43f5355caeb7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:13.837511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 356/732] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:13 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:13.838572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:13.946466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:13.947534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:13.948746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:13.949345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:13.951554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:13.952084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:13.953875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:13.975228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 377/733] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:13.980693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.063925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523a7f7-5acf-4863-9725-75eb1df3f205 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.114303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.115494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.115937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.116351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.117737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:14.118326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.120293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.127968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05a1d1-2a65-4826-8531-adeacd08f2a9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.143145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 357/734] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:14.149803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.154897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:14.174476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.175339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.176029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.176029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.187642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.189244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:14.209829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:14.210922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:14.211907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:14.211907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:14.211907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:14.211907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 378/735] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:14.219725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.225440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:14.278986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45b217-8f95-49ec-b9e2-257fac276321 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.324228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.325173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.325460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.326143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.343421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00be5-c957-4609-91b6-dd5e7d27e2f2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.384336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.385100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.385473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.385814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.386545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:14.386917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.388379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.402749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 379/736] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:14.414488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.426974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.429553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.434975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:14.571309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 358/737] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:31:14.577698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.618479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:14.715503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395ade6-bac1-47b8-88f6-66785e2b9aac None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.719445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:14.736173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdd596-36eb-4a65-aac5-27c06fadf8f5 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:14.762008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.763334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.764537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.765221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.779906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.781662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-6c0c4488-f526-4696-929a-aa714ae91144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:14.807668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:14.808824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:14.810104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:14.810104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:14.810104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:14.811745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 359/738] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:14.812157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:14.817392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8d2c-2ab3-4a4d-9d52-780dadf997ae None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.817392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8d2c-2ab3-4a4d-9d52-780dadf997ae None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.817392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed8d2c-2ab3-4a4d-9d52-780dadf997ae None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.817392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 360/739] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:14.817812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.818116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.818725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.820540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8d2c-2ab3-4a4d-9d52-780dadf997ae None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:14.837609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:14.839408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-960f1a4a-b915-4f2c-8099-26a244654ba1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:14.857028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:14.858103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:14.859094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:14.859714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 380/740] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:14.865512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:14.865668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:14.865942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:14.889055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:14.890772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:14.980664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 381/741] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:31:14.981617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.002612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed8d2c-2ab3-4a4d-9d52-780dadf997ae None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.104046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.104046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.104046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.104046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.104485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:15.104583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.104673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.104673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.135343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 361/742] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:15.141082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.172657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.195900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593ed0-27ee-483c-9753-0f513e2c21c8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.245962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.246638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.246913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.247328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.248149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:15.248453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.249903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.269629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 382/743] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:31:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:15.280157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.326381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df4a3-a837-4b12-baa6-92b0d82330a0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.391493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.392099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.392374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.392643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.403599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.405533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:15.419347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:15.420376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 362/744] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:15.421330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.446468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df8d94-a0f9-4fef-badf-abbaa62b5b47 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.461747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.484494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.485144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.485421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.485689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.508195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.538920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1cab0-cd2e-43ed-92c5-e9bcf496dc67 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.557623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.559118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b59c0e-5665-4af5-ae40-c1326c6bfe15 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.584076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.585281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.586069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.586952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.588102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.589982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32b58-23c6-4de6-b0bc-22aa97e00d81 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 363/745] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:15 2022] POST /identity/v3/services => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40af54-ebe7-4a9b-bf30-46a9c31a2b7a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40af54-ebe7-4a9b-bf30-46a9c31a2b7a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40af54-ebe7-4a9b-bf30-46a9c31a2b7a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 364/746] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:15.616788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40af54-ebe7-4a9b-bf30-46a9c31a2b7a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.679862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 383/747] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:31:15.681244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.681575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.681851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.702002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:15.703220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:15.719439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.767339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40af54-ebe7-4a9b-bf30-46a9c31a2b7a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.794121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 384/748] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:15.795322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.818397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:15.826594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.827530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.828459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.829048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:15.830204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:15.831652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:15.834043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:15.850539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 365/749] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:15.857499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:15.949085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200a754-6f01-4182-a4ff-aad37f43878e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:15.987716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:15.988422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:15.988702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:15.989003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.001183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.003796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.005703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:16.022513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:16.023536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:16.024428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:16.024428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:16.024428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:16.024428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 385/750] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:16.030726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.064381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a3cd6-2062-476d-a571-be0466c92f80 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.132559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.133210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.133484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.133752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.134490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=e008960a52884d03a887c3f356021795) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:16.134788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.136400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.148434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 366/751] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:15 2022] GET /identity/v3/role_assignments?user.id=e008960a52884d03a887c3f356021795&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:16.148434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.211404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.224685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250e63-f55a-4bca-b41f-9a61bb66c845 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.296610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc867ff9-25c0-43f5-ae9c-b0af0d48f388 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.304034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.304663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.304982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.305256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.305919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:16.306225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.307931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7635f9-f0d1-4d81-9c0c-35a4e43becfb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.322210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 386/752] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:16.327896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8bd2f-ea31-4afd-8489-e4a4e813a8da None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.327896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8bd2f-ea31-4afd-8489-e4a4e813a8da None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.327896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8bd2f-ea31-4afd-8489-e4a4e813a8da None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.329819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 387/753] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:16.330861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8bd2f-ea31-4afd-8489-e4a4e813a8da None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.344618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.345377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.345730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.346077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.357404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-158d4dbd-76ba-4b02-8784-bbfd05f73c75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:16.363553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:16.364523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:16.365407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 367/754] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:16.367686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.367686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.367853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.389974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:16.392645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:16.411187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.470296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8bd2f-ea31-4afd-8489-e4a4e813a8da None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.488560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 368/755] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:16.489665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.522774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.523814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.524335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.524815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.532151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.534443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:16.546655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:16.547584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:16.548495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:16.551278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 388/756] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:16.557079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.594216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.667925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02865c5b-e9b3-4905-b7cc-ef32d69bb1af None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.668450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947c03-325a-4aad-bf53-374b7612f364 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.691939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.711348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.713250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.713250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.713250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.713250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:16.713566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.714925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.717133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.717968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.718462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.719015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.719975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:16.720524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.722753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.728870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 369/757] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:16.730339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.736979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 389/758] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:16.749779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.861678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a512a3-fcaa-486a-9dbf-c0630336f994 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.873927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:16.905973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eade1fb-d80f-4729-ac3c-0ab6ed47da0d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:16.907934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.908785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.910002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.910002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.925932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.927567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:16.947474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:16.948640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:16.949587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:16.949587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:16.949587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:16.949587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 370/759] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:16.949820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:16.955541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:16.956697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:16.957184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:16.957459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:16.960972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=c051c9e64b2b4d16958cf716d3f6ff36) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:16.961333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:16.962783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:16.975549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 390/760] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/role_assignments?user.id=c051c9e64b2b4d16958cf716d3f6ff36&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:16.976196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.078029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5cedd-167c-4867-a631-3a694a83d09a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.109140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:17.120220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.121058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.121436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.122101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.122800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.124317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:17.135036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:17.136292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:17.137190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:17.138449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 371/761] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:17.144640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.176933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:17.231922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb17d6-6f2c-4d42-86aa-4cac7bfb05ef None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.281375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740715-5882-485d-acb7-3607df70ee2d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.317487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.318154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.318484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.318759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.319397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:17.319698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.321127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.326204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 372/762] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:17.331930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.348295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.348951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.349229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.349502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.350150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:17.350451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.351827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.377139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 391/763] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:17.383776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.510619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:17.533605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:17.534698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da28b01-ada1-4c47-9809-e813e612e636 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.539060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4660fd3-56fd-4650-9aa6-f4fd6b941b7c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.587588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.588573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.589846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.590360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.606101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.608189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.609625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.610517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.610984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.611444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.613040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:17.613935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.615643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.625239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 373/764] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:17.629886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:17.630851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:17.631799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:17.632332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.638598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 392/765] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:17.641112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.759512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca9a63-462e-422f-b0bb-3e602bf47f77 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.803131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.805313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.812790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.812790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.812790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:17.812790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.812790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e714174f-e466-4163-83da-84a66e3562f8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.850583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 393/766] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:17.855490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0965-66ab-43bf-be53-8b93f43f3e03 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.856023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0965-66ab-43bf-be53-8b93f43f3e03 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.856524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0965-66ab-43bf-be53-8b93f43f3e03 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.858296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 394/767] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:17.863596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a0965-66ab-43bf-be53-8b93f43f3e03 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:17.880641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305d82-028f-413f-be12-5b0dd0a38406 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.886334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:17.928732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:17.929498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.929773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.930070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.931484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] RBAC: Adding query filter params (interface=public, service_id=13f88f64c6294f7a8204a1f5580132a6, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:17.931809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:17.933521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432d03d-573d-41d0-b8df-6fbfe8356e69 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:17.944828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 374/768] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/endpoints?service_id=13f88f64c6294f7a8204a1f5580132a6&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:17.947212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:17.947503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:17.947793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:17.971569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:17.973248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:17.981862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a0965-66ab-43bf-be53-8b93f43f3e03 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:17.990250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:18.026785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.027855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.028354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.028910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.041544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.042998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:18.064578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:18.065638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:18.066675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:18.066675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:18.066675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:18.073076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 375/770] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:18.073076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.073426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 395/770] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:18.074872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.154405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:18.197281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c184d2-8939-4828-a4d0-9ad58221a4fe None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.240912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.241919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.242396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.243320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.244164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:18.244662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.246266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.267564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 396/771] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:18.270222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.293958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a2d78-6abf-4129-b46b-7fcd81c31aca None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.332292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.332895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.333172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.333498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.334353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.336477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3606-e015-4085-a8da-e4176eb87387 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.343262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 376/772] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:18.344697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea0b4-a015-4944-b830-9fcff4d192c3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.345015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea0b4-a015-4944-b830-9fcff4d192c3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.345287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea0b4-a015-4944-b830-9fcff4d192c3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.348845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 377/773] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:18.354071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.354388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.354618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.380610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:18.382732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:18.388702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:18.416492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cb619-117a-4ed2-a9a5-1d157c38197e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.453189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:18.463230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.463873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.464151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.464428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.472435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.474021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.480653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 378/774] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:18.490268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:18.604649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:18.605644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:18.606539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 397/775] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:18.611677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.629709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384742-3b78-4818-999d-dc155fbcedf2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.679377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.680263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.680607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.680985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] PATH_INFO: `/v3/services/network` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.681646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.683905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:18.697459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:18.698521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:18.699361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 379/776] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:18.704440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.710593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:18.749223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005b09-9447-4d84-b9f5-c370b5e0dd2b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.846250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ac7d-377d-48de-8682-7b57f5fcf341 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:18.848078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.848691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.848985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.849249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.849943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:18.850351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.852139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.880103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 398/777] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:18.888835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.890948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:18.892338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:18.892855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:18.893449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:18.894296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:18.895996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:18.897636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:18.903826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 380/778] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:18.910635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:18.997233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.002223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.009198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad6160-c4ad-4af0-9298-a66b348635c9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.042523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d006d6-22ce-4e59-8ae8-b510880056e2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.046363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.047024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.047298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.047567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.049687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=211155364dfd4a60bc13efa3c7d7fa98, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.051082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.068251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 399/779] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:18 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:19.069669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.081492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.082123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.082440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.082835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.083485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:19.083795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.085462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.091763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 381/780] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:19.097743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.188264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b92b34-b807-47b4-89ec-cc5210a86c2a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.198363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.228398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.229084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.229362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.229632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.235416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fa48-e69d-49d2-9976-6146c5eff6e5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.242166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:19.247031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:19.248048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:19.248950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 400/781] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:19.254986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.282264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.289777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.292085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.292371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.292638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.295050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] RBAC: Adding query filter params (interface=public, service_id=4b10f6ce2f82473db9b9af7b24f40f4c, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:19.295366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.296784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.311289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 382/782] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/endpoints?service_id=4b10f6ce2f82473db9b9af7b24f40f4c&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:19.317968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.406800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c21a0-8edd-45e5-b7b2-25d75a4bf279 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.444794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.445334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.445612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.445883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.446539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:19.446839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.448429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66f751-9ffe-4632-9ddc-2fff915c0987 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.451867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c00b-3cb1-4bfd-9f6a-8a752dada949 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.459085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 401/783] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:19.460408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135dca-3b08-4328-983a-8b48983442c8 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.460690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135dca-3b08-4328-983a-8b48983442c8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.460988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16135dca-3b08-4328-983a-8b48983442c8 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.462530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 402/784] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:19.464596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135dca-3b08-4328-983a-8b48983442c8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.495653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.496781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.497639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.498061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.499080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.500080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.502010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114c7c-e6f5-45ff-bd36-7bdda68eacac None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.515286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 383/785] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:19.516934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.517348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.517747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.541395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:19.543427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:19.653132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:19.659191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16135dca-3b08-4328-983a-8b48983442c8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.675745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 384/786] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:19.706404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.706959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.707255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.707491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.718562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.720052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:19.736810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:19.737955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:19.738861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:19.738861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:19.738861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:19.738861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 403/787] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:19.743992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:19.854148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e76e-36cf-4c0d-8dba-7385d9ece124 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:19.900252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:19.900915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:19.901165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:19.901432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:19.902083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:19.902382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:19.903762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:19.924227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 385/788] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:19.930209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.031837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.041117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.060618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7704bcb-d94f-49cd-94ac-e23b4b78a547 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.098901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.099578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.099955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.100236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.108107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.109566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.114117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:20.123217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:20.124215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:20.125196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:20.128177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 404/789] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:20.136081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.253411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867adf90-1ed2-4778-8c0b-9b223baaa751 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.294123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.295082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.295504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.295917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.296803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:20.297350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.299048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.302946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423a383-9831-4ccd-9d25-d454b6440a30 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.319384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 405/790] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:20.319930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.326363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.374763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.375397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.375669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.375941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.397523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:20.402802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:20.403722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:20.404575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:20.405785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 386/791] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:20.412567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.507664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4dce-9633-4273-a9d3-600c5bcdf509 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.566772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.567312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.567578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.567840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.584038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.585517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.601475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327af553-376e-44f0-a622-07ba341ff7ac None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:20.618429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:20.619497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:20.620394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:20.620394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:20.620394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:20.622198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.626549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 406/792] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:20.627753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.669986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.670596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.670873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.671142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.671802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:20.672101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.673512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f3701-c843-409e-b4f4-24e05a605788 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.682784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 387/793] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:20.684086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897fc8-69b7-4acc-97ab-e6aa7c70d8ff None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.684369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897fc8-69b7-4acc-97ab-e6aa7c70d8ff None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.684641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897fc8-69b7-4acc-97ab-e6aa7c70d8ff None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.692894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 388/794] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:20.692894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897fc8-69b7-4acc-97ab-e6aa7c70d8ff None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.708604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.762311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3e848-5804-4932-afae-ec38ef51a87d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.813408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.814527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.815103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.815585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.816310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:20.816682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.819134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5586bfb-edfc-4343-abb8-fe6319a4aabc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.825101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897fc8-69b7-4acc-97ab-e6aa7c70d8ff None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:20.838849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 407/795] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:20.838849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.838849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.838849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.860648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:20.863042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:20.872302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:20.873476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:20.873953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:20.874561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:20.890000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:20.892540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:20.916479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:20.917985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:20.918891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:20.918891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:20.918891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:20.922512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 389/796] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:20.923980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.945541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 408/797] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:20.947143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:20.957432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:20.994302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.051040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99040e46-7ec6-4dc6-a5ab-6f7e65dd3d96 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.069665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdcd5af-e044-436b-b2b3-c1cb69dec8df None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.110682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.111290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.111567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.111868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.112517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:21.112840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.114212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.127147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.128413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.128693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.128993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.136803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 409/798] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:21.141351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.142824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.149778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:21.162600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:21.163554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:21.164455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:21.166903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 390/799] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:21.172863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.278321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a557f-35e2-4453-8fc1-18034e211286 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.280002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.343984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.345587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.346644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.348190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.349314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.364118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.366456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.385162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c7378-76b9-4558-9a3b-9b28a3eed568 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:21.392508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:21.394235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:21.395672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:21.397420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 410/800] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:21.398304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.425859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.431612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.444288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 391/801] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:21.445425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.532627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac40864-68f3-4f25-acc2-1c18b73dcd22 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.571115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.571332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bd3a-b444-4f1f-9af5-2bbc771886d3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.572120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.572666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.573106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.573950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.575321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:21.587831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:21.589050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:21.589927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 411/802] 10.222.0.70 () {56 vars in 1129 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:21.590745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.613083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.613604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.613880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.614261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.614980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:21.615283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.616688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbd3fd-1ac3-4e41-9545-51219e7d1f6a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.620278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.635177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 392/803] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:21.636409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5c05-7d41-4085-88c9-452ad95eb57b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.636691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5c05-7d41-4085-88c9-452ad95eb57b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.636991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5c05-7d41-4085-88c9-452ad95eb57b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.640798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 393/804] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:21.640798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5c05-7d41-4085-88c9-452ad95eb57b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.642143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.713437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc64a1-77d3-4793-87ac-1cf70214f9fc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.747570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.747777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5c05-7d41-4085-88c9-452ad95eb57b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.748215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.748485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.748749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/e008960a52884d03a887c3f356021795/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.763597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=e008960a52884d03a887c3f356021795, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.765086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.778855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 412/805] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:21 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/e008960a52884d03a887c3f356021795/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:21.779643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.785035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.785666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.785942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.789455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.789455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:21.789455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.789915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa832ef-31a5-41a5-be15-87bc42218c51 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.797896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 394/806] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:21.800237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cbd5-e6f9-4a91-8fd3-08b6516fd175 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.800788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cbd5-e6f9-4a91-8fd3-08b6516fd175 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.801339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cbd5-e6f9-4a91-8fd3-08b6516fd175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.824488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6788cbd5-e6f9-4a91-8fd3-08b6516fd175 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:21.825792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6788cbd5-e6f9-4a91-8fd3-08b6516fd175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:21.870757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.900509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:21.901936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbec210-c425-480b-9888-837ccf3e2689 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:21.910562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 395/807] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:21.911466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1783-a2dd-486a-a2e0-be6350931ed7 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.911749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1783-a2dd-486a-a2e0-be6350931ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.912019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a1783-a2dd-486a-a2e0-be6350931ed7 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.916861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 396/808] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:21.916861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1783-a2dd-486a-a2e0-be6350931ed7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:21.965990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:21.966781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:21.967184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:21.967550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:21.978663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:21.980233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-51bdaef3-7625-4703-ab99-7902b67d6e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:21.995486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:21.996668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:21.997656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:21.997656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:21.997656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:21.998517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 413/809] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:22.003417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.003417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.003417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.021308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:22.022524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:22.055027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a1783-a2dd-486a-a2e0-be6350931ed7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.093946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.094884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.095527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.096608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.097736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:22.098252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.099872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.101045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 414/810] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:22.102078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.106734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 397/811] 10.222.0.70 () {56 vars in 1124 bytes} [Wed Aug 31 10:31:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:22.117925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.181973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.218174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d774-4cac-48f7-a385-5e89cf5e24c9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.228819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.258816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.259455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.259855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.260126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.260788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:22.261095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.262513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.273860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936ef42-9ad6-49e3-8107-cdfdefb98b0b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.276027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 415/812] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:22.280853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.326471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.327721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.328412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.328856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.329930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.332853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.362994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 398/813] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:22.364208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.429925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ce34d-32a9-417f-9a69-0751d34370db None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.453545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.486062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.487597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.488021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.488502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.504200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:22.511686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:22.512911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:22.513772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:22.514422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 416/814] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:22.516025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.529175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d7d2f-b65b-40aa-9b41-6cf5ae65f41e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.550000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.570645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.571605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.572079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.572560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.579812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.581688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:22.597167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:22.598110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:22.599009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:22.601406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 399/815] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:22.606789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.643456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98947006-8ddf-4b9b-831e-f10d24cbf8f8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.695297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.696275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.696736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.697244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] PATH_INFO: `/v3/services/network` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.698232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.701324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:22.719824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:22.722271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:31:22.724394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:22.728850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 417/816] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:22.731621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.751958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b63c3-1ca5-4303-9415-ba0ba7d707dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.816522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.817176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.817516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.817795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.818473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:22.818775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.820148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.821105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.829176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 400/817] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:22.830027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.881295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b388f8-f12c-43ed-a032-0f4cb87f3566 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.884176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:22.924162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.925273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.925698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.926111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.926978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:22.927437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.929057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:22.941730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 418/818] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:22.942860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:22.954603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346e971-3f88-4519-9df0-54ceb95c5e99 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:22.992674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:22.993256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:22.993655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:22.993933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:22.994580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] RBAC: Adding query filter params (name=network) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:22.995001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:22.996413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.001766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 401/819] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:23.002612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.042832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:23.047257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f651e2-2e68-423e-b8e5-5c2e4902bb2a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.083049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.084020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.084514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.085007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.095958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.097879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:23.112895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:23.113941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:23.114827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:23.114827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:23.114827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:23.115744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ddb0a-fa38-4d31-a767-c3a20b25ef70 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.121659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:23.121904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 419/820] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:23.123063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.154038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.154790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.155069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.155395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/c051c9e64b2b4d16958cf716d3f6ff36/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.157477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=c051c9e64b2b4d16958cf716d3f6ff36, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.159922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.184313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 402/821] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:23 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/c051c9e64b2b4d16958cf716d3f6ff36/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:23.185503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.255242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1598d-d5a0-4a41-b781-a781eb6f7aac None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.302575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.303203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.303479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.303754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.304515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] RBAC: Adding query filter params (type=network) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:23.305489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.307564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.316824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 420/822] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:23.323027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.344973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:23.367750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abd993-c199-4234-a281-405f086fe4cd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.413104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.413593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.413872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.414143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.414799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:23.415373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.419114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.436861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 403/823] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:23.448694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.453435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94309fc1-309e-43ff-8c2a-b931df476892 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.489922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad107-4436-4467-8058-87c67859956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.490592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad107-4436-4467-8058-87c67859956e None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.490872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad107-4436-4467-8058-87c67859956e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.491018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:23.491123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad107-4436-4467-8058-87c67859956e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.491860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ad107-4436-4467-8058-87c67859956e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.493259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ad107-4436-4467-8058-87c67859956e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.525513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 421/824] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:23.597589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2252d-54cf-489c-b565-5a6dc025a1e2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.654948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.655607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.655938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.656215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.670185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.671890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-7cb5eb52-83d7-4536-a65d-2db633f965ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:23.687130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:23.688156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:23.689141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 404/825] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:23.694776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad107-4436-4467-8058-87c67859956e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.780524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:23.819994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad107-4436-4467-8058-87c67859956e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:23.854960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eabd78-f730-4054-a895-d5778201edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:23.855563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eabd78-f730-4054-a895-d5778201edce None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.855838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eabd78-f730-4054-a895-d5778201edce None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.856108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eabd78-f730-4054-a895-d5778201edce None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.856862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eabd78-f730-4054-a895-d5778201edce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:23.857167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eabd78-f730-4054-a895-d5778201edce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:23.858580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eabd78-f730-4054-a895-d5778201edce None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:23.877131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 422/826] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:23.883742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eabd78-f730-4054-a895-d5778201edce None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:23.883890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e056-b4f9-4870-ba3f-bbea6ab1b2d2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.885810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e056-b4f9-4870-ba3f-bbea6ab1b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.885810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5e056-b4f9-4870-ba3f-bbea6ab1b2d2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.885810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 405/827] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:23.891235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:23.891525 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:23.891802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:23.919645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:23.920916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:23.998770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eabd78-f730-4054-a895-d5778201edce None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.010037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 406/828] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:24.035923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.051235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.052547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.053079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.053522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.133523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.135289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.241651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 423/829] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:31:24.246899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.263087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.327142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.356350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79326ac-ccd4-419c-97bf-aea587449e95 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.362302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.402690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.403320 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.403596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.403863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.416446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.418622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:24.438131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:24.439143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:24.440105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:24.440105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:24.440105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:24.440290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 407/830] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:24.441436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392fc7-3316-41c0-9ed6-40798f2dd042 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.449711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.485960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.487500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.487879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.488146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.501381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:24.506830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:24.507863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:24.508701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 424/831] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:24.513676 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.535669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.596398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e2475-a503-4950-8b1e-82af8b6b4e6b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.626394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.634322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.634954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.635233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.635506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.636166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:24.636442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.637855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c5ef2-d864-4975-b913-639ee3a63d92 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.643883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4eb2d-8ac7-4abf-89b4-175e03b20c3c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.684164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.685174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.685650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.686141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.687021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:24.687523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.689255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.699882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 425/832] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:24.713983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.767737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 408/833] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:24.770652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25704-e26d-432f-88de-e94c717857e3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.771010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25704-e26d-432f-88de-e94c717857e3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.771283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25704-e26d-432f-88de-e94c717857e3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.772545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 409/834] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:24.773713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25704-e26d-432f-88de-e94c717857e3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:24.835519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3c77-5a6d-4d39-93b8-9117d315a9e8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.875298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.875845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.876129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.876823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.889396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.890844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.891240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25704-e26d-432f-88de-e94c717857e3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-2b26ffa4-48cf-40a1-ac12-9d08c2f72805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:24.906328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:24.907301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:24.908210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:24.908210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:24.908210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:24.908210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 426/835] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:24.908972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.909076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.909574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.916546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.920844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:24.929349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:24.930537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:24.937173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:24.938211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:24.938504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:24.938777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:24.947104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:24.948747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:24.960480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:24.961446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 410/836] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:24.963010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.007137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 427/837] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:25.013959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.069733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2ea07-665f-4964-b890-0668a37e8de7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.106290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.107247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.107247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.107534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.108173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.108477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.109881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.127258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 411/838] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:25.130705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.152216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6c318-274e-4c21-9d72-8967e5188e2a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.190543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.192078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.202542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.205168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.206501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.207142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.208104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.208614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.210604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.225007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 428/839] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:25.232929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.251911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2af4-ec03-434f-88a2-f8bc09282b44 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.288966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.289606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.289883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.290153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.297756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.299753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:25.311476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:25.312467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 412/840] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:25.314043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.350103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58a35f-6b7e-4cb9-90c6-4a77743e245d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.384305 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.384862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.385133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.385398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.386111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.386414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.387829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.394059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 429/841] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:25.395168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.424743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.428887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930266-3e69-4b54-857d-6471fca52a30 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.467842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.468495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.468798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.469066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.469659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.471107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.476270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9213448a-93b2-4acc-86bb-bdf694776e29 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:25.480673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:25.481762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:25.482598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 413/842] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:25.483407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22892bd3-40aa-4129-8860-145cdc843fcd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.483407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22892bd3-40aa-4129-8860-145cdc843fcd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.484453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22892bd3-40aa-4129-8860-145cdc843fcd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.489552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 414/843] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:25.489552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22892bd3-40aa-4129-8860-145cdc843fcd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.537220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6404c7-b685-423a-b721-2502395db264 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.588829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.588829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.588829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.588829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.589283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.589283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.589283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245608d2-7feb-4aeb-b67c-529c9b68223d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.608132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 430/844] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:25.612948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22892bd3-40aa-4129-8860-145cdc843fcd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.613101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.613101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.613101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.628707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:25.629958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:25.649622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.650146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.650418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.650682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.651298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.651602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.653061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.657781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 415/845] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:25.659038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.690198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.705271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 431/846] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:25.706191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:25.758563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.791955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f9730-81b8-4cdc-a430-00bdbe6da354 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.825538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688f3fa-3d48-43a0-9fcc-94269e99f715 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:25.827405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.828122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.828789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.829321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.863237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:25.864095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:25.864510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:25.864956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:25.865754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:25.866205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.867728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.881359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 432/847] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:25.914373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:25.915940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:25.948123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:25.981188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.032691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 416/848] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:26.039894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.108937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267a359-f359-4a68-8282-044e2aaceada None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.119882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.147901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.149361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.149793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.150213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.151221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28169ab-8447-47c4-826b-db955e1fd87c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.164117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:26.170999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:26.172150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:26.173259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:26.177218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 433/849] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:26.182345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.183957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.191897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.192661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.193070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.193434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.204225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.206351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:26.222375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:26.223731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:26.224879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:26.224879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:26.224879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:26.226192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 417/850] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:26.232810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.333237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aecfd-7fbe-4687-964d-deb7f95e4a82 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.347830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04d5a4-f3af-4526-9a76-0e1f1f05b5a4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.382512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.383597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.384026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.384304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.384621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.385014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.385209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.385373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.385979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:26.386276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.386694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:26.387239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.387693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.389328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.400796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 418/851] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:26.404989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 434/852] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:26.406104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.412504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.449428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.455137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.521621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ce222-7a4a-4d59-b036-d8f9c92394aa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.544383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e859d1-1b1b-4ad4-b5e7-e0b299702b54 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.559666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.560522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.561001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.561409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.569029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.570772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:26.583701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:26.584672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:26.586003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:26.586781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 419/853] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:26.592408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.593093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.593977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.594509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.594972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.608000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.609799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:26.625187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:26.626160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:26.627085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:26.627085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:26.627085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:26.629452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 435/854] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:26.634804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.708405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.711766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21beed-805d-49a5-8236-32e6974036c9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.741104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:26.749736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.750707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.751207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.751671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.752621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:26.753209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.754828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.761226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda062b-1e14-4050-b618-3d3256b83d65 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.768822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 420/855] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:26.775131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.807257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.808367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.809187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.810111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.810971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:26.811569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.813820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.837443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 436/856] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:26.838621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:26.913024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970e3c6-fced-486a-ace7-9e95323c5e2e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.957715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:26.958968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:26.959376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:26.959747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:26.960736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=e008960a52884d03a887c3f356021795) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:26.961164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:26.963341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:26.968432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d15f-285b-481c-8798-adfd4945b859 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:26.972979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 421/857] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/role_assignments?user.id=e008960a52884d03a887c3f356021795&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:27.016949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:27.017876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.018314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.018741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.027657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:27.029442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:27.043516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:27.044714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:31:27.045894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:27.048188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 437/858] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:27.057995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.086856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.170154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777b97-83f0-4d85-ba83-17174dcee21a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:27.206296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:27.206914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.207196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.207467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.208269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:27.208581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:27.210160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee2e1d-821b-4506-a37a-c7511f9f1e3d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:27.234328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 422/859] 10.222.0.70 () {56 vars in 1135 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:27.240904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.247528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.356631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cf59a-82fc-49b6-a50e-b1cabb2e6a24 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:27.392283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:27.393597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.393875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.394234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.461183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501532a-5d41-4d9e-9aab-3c7bc5560e47 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.461374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501532a-5d41-4d9e-9aab-3c7bc5560e47 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.461616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501532a-5d41-4d9e-9aab-3c7bc5560e47 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.464954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 423/860] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:27.468153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.468437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.468705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.469631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:27.472042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:27.489047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:27.490393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:27.525129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.576136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 424/861] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:27.590984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 438/862] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:27.596349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.611155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.703444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00efa2-e2f8-4c0b-8723-5e316c265cb5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:27.739343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:27.739889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.740160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.740427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.750853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:27.752895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:27.767608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:27.768592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:27.769811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:27.769811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:27.769811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:27.769811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 425/863] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:27.776010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.850223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.901992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400122a-69fd-48b1-a823-46733b89fd4d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:27.904057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.927343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:27.943953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:27.944778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.944993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.945259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.945891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:27.946196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:27.947547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa63038-2443-4dd8-b770-076dfa0ea2fc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:27.959588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 439/864] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:27.960966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0e21-3bee-48fc-a4fa-7ae4b3c26133 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:27.961325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0e21-3bee-48fc-a4fa-7ae4b3c26133 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:27.961661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed0e21-3bee-48fc-a4fa-7ae4b3c26133 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:27.963068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 440/865] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:27.965259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0e21-3bee-48fc-a4fa-7ae4b3c26133 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:27.975206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c177bb3-5eb7-4ee7-9758-3da47b4992e9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.012405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.012968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.013244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.013514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.014083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.015436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b6f0449d-e6ff-4f1d-8e63-2a9f062c185f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:28.024240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:28.025289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:28.030981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 426/866] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:28.031820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.031820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.031820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.046720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:28.047916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:28.085415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed0e21-3bee-48fc-a4fa-7ae4b3c26133 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.120954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 427/867] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:28.121812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:28.133705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.134701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.135234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.135708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.147194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.149781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:28.167576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:28.168528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:28.169476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:28.177319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 441/868] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:28.179491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:28.194637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:28.217164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:28.242395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68653f52-0a8a-42df-8344-a22a6b7e0aa4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.284156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.285306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.286234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.286662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.287749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:28.288548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.290798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.295686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5c289-3fc4-485e-b6d9-37abf5ec2ab4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.297851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 428/869] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:28.304267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:28.338929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.339863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.340335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.340957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.341865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:28.343260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.344986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.360998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 442/870] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:28.367170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:28.413358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e6a7-5702-4b8d-b49f-c0e5df65a5d6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.436698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:28.450243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.450846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.451118 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.451382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.452006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:28.452301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.453687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.458686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 429/871] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:28.458686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:28.472352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:28.496411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808739c-1da8-4625-9103-77ecf3da7b0f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.544383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.544951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.545514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.545788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.546534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=c051c9e64b2b4d16958cf716d3f6ff36) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:28.547120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.550078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86a656-0b54-4a96-b814-c92f40f1ed5e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.558934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 443/872] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:28 2022] GET /identity/v3/role_assignments?user.id=c051c9e64b2b4d16958cf716d3f6ff36&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:28.614866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da9f7e-4c6c-45cc-8ade-5967d639a21a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:28.655729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:28.656534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:28.656941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:28.657304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:28.658059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:28.660088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5969c-dc60-490a-91b4-d641b9ff8faa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:28.679972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 430/873] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:28 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:29.144096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ae7-f75c-4331-9db7-bd884b62f81e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:29.144784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ae7-f75c-4331-9db7-bd884b62f81e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:29.144971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e7ae7-f75c-4331-9db7-bd884b62f81e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:29.146548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 444/874] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:29.151984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:29.152273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:29.152553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:29.171022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:29.172214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:29.215785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:29.248332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 431/875] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:29.521208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7ae7-f75c-4331-9db7-bd884b62f81e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:29.629023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e7ae7-f75c-4331-9db7-bd884b62f81e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:29.665169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:29.665801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:29.666083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:29.666352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:29.677004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:29.681798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:29.682749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:29.683608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 445/876] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:31:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:29.689148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:29.794467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d775d-6a91-45d8-974c-1b34c0c0e533 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:29.830800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:29.831414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:29.831686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:29.831951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:29.832616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:29.832942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:29.834313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:29.843329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 432/877] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:31:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:29.850092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:29.860268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:29.960327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa662e-ac05-4162-91a9-4a29e588db90 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:29.994682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:29.995309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:29.995587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:29.995861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.007010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:30.008459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:30.023156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:30.024167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:30.025737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:30.025737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:30.025737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:30.025737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 446/878] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:30.030464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.067994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:30.140122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a851b-ecba-46ba-ab96-dabc4206d11f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:30.175823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:30.176431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.176709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.177011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.177655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:30.177958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:30.179332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:30.193028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 433/879] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:30.198519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.261382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:30.305541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc731b45-96d3-4aa2-94a0-9fc93eeb748d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:30.341389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:30.342020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.342297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.342568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.350613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:30.352060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-77b3b4e3-41e8-4745-a87c-dd09d7000d9e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:30.365338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:30.366322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:30.367881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 447/880] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:30.373821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.474533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:30.479878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3995-fb92-48e5-8612-630791e13f62 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.480416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3995-fb92-48e5-8612-630791e13f62 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.480916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3995-fb92-48e5-8612-630791e13f62 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.482611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791c11-bf11-45c9-8acd-cecb83bdecee None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:30.483010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 448/881] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:30.488409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1329b-53c3-4556-9136-fa12fc41c311 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.488677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1329b-53c3-4556-9136-fa12fc41c311 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.488987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1329b-53c3-4556-9136-fa12fc41c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.508221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bbf1329b-53c3-4556-9136-fa12fc41c311 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:30.509821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bbf1329b-53c3-4556-9136-fa12fc41c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:30.523720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:30.524319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.524590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.524881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.525869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:30.526168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:30.528323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:30.550690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 434/882] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:30.556342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.592035 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 449/883] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:30.671554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493447d9-745c-4fee-bf04-31417ddb32bc None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:30.675605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5419-9ced-4c62-a573-b456271258cc None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.676123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5419-9ced-4c62-a573-b456271258cc None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.676614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5419-9ced-4c62-a573-b456271258cc None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.678410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 450/884] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:30.683837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308edc-8e27-4228-ab1d-f114935fb900 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.684364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308edc-8e27-4228-ab1d-f114935fb900 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.684900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308edc-8e27-4228-ab1d-f114935fb900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.705003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9a308edc-8e27-4228-ab1d-f114935fb900 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:30.706704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9a308edc-8e27-4228-ab1d-f114935fb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:30.710845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:30.711454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.711728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.711995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.738692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:30.756294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:30.782549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 451/885] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:30.784471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122162-259f-434f-92ac-c7d655dca459 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.784766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122162-259f-434f-92ac-c7d655dca459 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.785075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de122162-259f-434f-92ac-c7d655dca459 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.786477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 452/886] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:30.791854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:30.792376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:30.792886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:30.805917 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:30.807450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:30.816988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:30.818805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:30.899298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 453/887] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:30.900473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.922360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 435/888] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:30 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:30.928330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:30.997748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.013232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265f12a-ac81-40a8-977b-262e0adfd549 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.024150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.052871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.053939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.054401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.054668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.055313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.056664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.059993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b4f62-11b2-471a-a7f7-76e010b22a68 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.075936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 454/889] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:30 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:31.077748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.119198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.120435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.121244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.121773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.135315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.137463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:31.156713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:31.157750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:31.159259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:31.159259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:31.159259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:31.161896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 436/890] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:31.167144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.209368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c33b6-729d-461d-9df8-cda330c03288 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.251030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.251662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.252016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.252397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.253014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.254393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:31.265852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:31.266891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.268288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 455/891] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:31.269342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.289778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.292910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e9af2-2045-456d-b011-3625581ebec7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.307293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.332603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.333267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.333548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.333820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.334458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.335035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.336327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.350186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 437/892] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.350922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.388538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1775c-acc9-4c5b-a8ee-90a925d9626f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.425639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.426195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.426471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.426741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.427314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.428678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:31.438437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:31.440125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.441025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 456/893] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:31.441834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.466996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bd881-be78-49e8-bfc9-bf5105ba5f59 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.507698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.508300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.508575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.508935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.509568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.509866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.511228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.515946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 438/894] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.516716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.543245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.555109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.561529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ce69-fba6-40cb-82bb-c9622a7ff3bc None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.603964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.604728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.605142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.605413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.614678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.616775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.622200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f49041-0f58-4173-8df6-f63b8ce7934e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:31.631307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:31.632292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:31.633660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 457/895] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:31.634157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.666568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.667170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.667430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.667702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.668321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.668632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.670090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.680110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 439/896] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.680110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.743043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-ea85-4283-acc5-946dba200452 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.770919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.777768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.778372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.778649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.778923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.779549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.779851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.781260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.785611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8ec71-86d6-415f-96fb-ebb9e676d2e8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.785741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 458/897] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.786521 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.816696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:31.838959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.839890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.840313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.840816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.841675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.842214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.843999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.858563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 440/898] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.864908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.933342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507718c-0132-47b1-9fd2-2d1d57c57401 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:31.975899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:31.976507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:31.976814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:31.977088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:31.977715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:31.978013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:31.979372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:31.985310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 459/899] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:31.991069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:31.991658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07fefb-b8f5-4437-b243-817b27a7a725 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:32.040413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:32.041670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:32.042533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:32.043068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:32.043993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] RBAC: Adding query filter params (role.id=69d4e4013a0a4892bff820ec2b11920d, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=e008960a52884d03a887c3f356021795) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:32.044518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:32.046992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:32.057281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 441/900] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/role_assignments?user.id=e008960a52884d03a887c3f356021795&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=69d4e4013a0a4892bff820ec2b11920d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:32.087366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:32.107015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44df26-e2f1-45d1-9bac-49204d5f1b18 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:32.148280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:32.148939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:32.149214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:32.149484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:32.150195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] RBAC: Adding query filter params (interface=public, service_id=095e696318724565aba8233de3d27d96, region_id=RegionOne) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:32.150498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:32.151892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40a715-f51d-4375-98a1-ec70f62849cf None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:32.164473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 460/901] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:31 2022] GET /identity/v3/endpoints?service_id=095e696318724565aba8233de3d27d96&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:32.166897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:32.190082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:32.279018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f0e6c-5a64-4191-a02d-3daab6985320 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:32.315034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:32.315984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:32.316462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:32.316953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:32.317756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:32.319539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b908-2dca-44f7-b9e5-583cb98108d2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:32.325948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 442/902] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:32 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:31:33.053421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86a51-51c3-4507-9e93-9509c9349172 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.053931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86a51-51c3-4507-9e93-9509c9349172 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.053931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e86a51-51c3-4507-9e93-9509c9349172 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.055584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 461/903] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:33.060609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.061015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.061181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.079822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:33.081293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:33.153580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 443/904] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:33.434866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86a51-51c3-4507-9e93-9509c9349172 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:33.542155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e86a51-51c3-4507-9e93-9509c9349172 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:33.577664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:33.578294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.578567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.578840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.579417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:33.580965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:33.590118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:33.591081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:33.592586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 462/905] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 31 10:31:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:33.597714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:33.605739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:33.715012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f882a-f273-4b92-9148-4ba80de10151 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:33.750295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:33.750904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.751180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.751448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.752726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:33.753273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:33.754648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d3e4-2056-43eb-b64f-0db1fcf40aa3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:33.759736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 444/906] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:33.766115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:33.785162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:33.858248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2523-0e73-4594-9072-132c8eaffff0 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.858579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2523-0e73-4594-9072-132c8eaffff0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.858807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb2523-0e73-4594-9072-132c8eaffff0 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.860284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 445/907] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:33.866624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283cb97-38d6-4356-94a8-6e3e719acdb5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.867212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283cb97-38d6-4356-94a8-6e3e719acdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.867682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283cb97-38d6-4356-94a8-6e3e719acdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.873526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d83181-b684-46c1-b8ce-2cf3556a5765 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:33.887165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9283cb97-38d6-4356-94a8-6e3e719acdb5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:33.888745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9283cb97-38d6-4356-94a8-6e3e719acdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:33.909968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:33.910622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:33.910916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:33.911178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:33.911804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:33.912100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:33.913537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:33.919268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 463/908] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:33.925642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:33.962836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:33.973751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 446/909] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:34.010110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:34.039404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28211123-f398-4201-8f0e-4d82b21c43ed None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.070724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023da5-501b-4d33-9898-7eb4724349ef None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.071779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023da5-501b-4d33-9898-7eb4724349ef None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.072335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c023da5-501b-4d33-9898-7eb4724349ef None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.074707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 447/910] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:34.078736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.079345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.079621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.079941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.080416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.080641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] RBAC: Adding query filter params (interface=public, service_id=8cddb2c6dbf440fea3c2b7e07844a69c, region_id=RegionOne) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:34.080970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:34.081324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.081863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.082449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:34.092789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 464/911] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:33 2022] GET /identity/v3/endpoints?service_id=8cddb2c6dbf440fea3c2b7e07844a69c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:34.093621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.103967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:34.105625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:34.188970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 448/912] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:34.210365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7836bc-6aff-461a-93f9-effe5f9ca9e2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.252189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.253186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.253680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.254159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.254968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:34.256565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318771f-59be-40e9-9a5b-94ac11e7ef43 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:34.263040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 465/913] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:31:34.286160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.310889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225479c-0a01-4424-8a17-353642769142 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.311174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225479c-0a01-4424-8a17-353642769142 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.311461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225479c-0a01-4424-8a17-353642769142 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.312791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 466/914] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:34.318498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.318829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.319242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.326788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:34.341102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:34.342349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:34.416052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a0462-b3f3-4e45-ab0b-dce58d6cf290 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.427230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 467/915] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:34.453516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:34.459879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.460705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.461194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.461680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.462347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:34.463724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:34.479122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 449/916] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:34 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:34.482553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.602149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e160eec-f58a-463e-8ee6-c9e1edab7d5d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.640573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:34.646879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.647860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.648527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.648817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.660547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:34.665685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:34.666707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:34.667623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 468/917] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:34.672915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.702176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.789845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f4ee3-4b1b-4555-b405-54850d441cdf None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.820863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e0244-feb0-4ed6-a01c-1ca7da041271 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:34.840976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.841842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.842296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.842745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.844100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:34.844562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:34.847401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:34.859097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:34.859766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:34.860128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 450/918] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:34.864967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:34.865261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:34.865918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:34.867377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:34.869209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:34.877691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:34.878808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:34.880040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 469/919] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:34.884953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:34.943985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:34.948699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:35.008063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4394ef9-41d4-43e1-a247-6db1f9e4d6c8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.016196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094dd762-517f-4d0b-9590-a516b533d0d5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.047171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.047782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.048059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.048331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.049662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:35.050023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.051327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.061372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 470/920] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:35.061819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.062278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.062468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.062709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.062974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.077442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.079644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:35.099077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:35.100078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:35.101227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:35.101227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:35.101227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:35.104846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 451/921] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:35.106569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.170817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10fa66-14f5-425d-98c1-fff2cf453d11 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.194831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:35.214532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.215141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.215418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.215689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.216318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:35.216620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.218031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.225168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 471/922] 10.222.0.70 () {56 vars in 1114 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:35.229597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.250534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5ad-123e-46f4-bd1f-a03df8eeac57 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.254421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:35.299597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.300549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.301270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.301780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.303178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:35.303903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.306542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.326489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 452/923] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:35.327271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.353810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e872-acec-4d5a-acb7-4730bf6d5f63 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.399355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.400547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.401396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.402105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.402941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.405334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.434638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 472/924] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:35.452559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562809-6169-49ae-8b9e-237566f64471 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.505433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.506084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.506360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.506630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.515182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.516697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:35.530710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:35.531758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:35.532727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 453/925] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:35.540427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.586111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:35.656469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a15c7-88a5-414e-9d9d-4a5da7777dd6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.696118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.696645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.696961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.697233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.698029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:35.698331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.699807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.718434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 473/926] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:35.725016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:35.749505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:35.837529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb836de-4f0f-43ed-bbd4-fd5dac05029a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:35.873444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:35.874072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:35.874352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:35.874626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:35.886610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:35.888079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:35.903466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:35.904427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:35.905360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:35.905360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:35.905360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:35.905360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 454/927] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:35.912344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.011189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:36.017368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8306-1577-489a-9fe0-74de85dacc35 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:36.053969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:36.054953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.055436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.055948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.056837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:36.057341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:36.059001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:36.071399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 474/928] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:36.077345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.151338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:36.185270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823974da-aa2d-456a-9eaa-8fc4e6bf031f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:36.219520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:36.221190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.221740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.222234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.229786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:36.231602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3785f871-de06-43ab-9896-b5d7a48dae57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:36.244338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:36.245368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:36.246305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:36.248888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 455/929] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:36.255463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.367025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01178c2f-9b80-49e5-9d72-2fbcf1a3533b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:36.391296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7947f-7d96-409f-a3bc-438a8249ec66 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.391894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7947f-7d96-409f-a3bc-438a8249ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.393066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7947f-7d96-409f-a3bc-438a8249ec66 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.395953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 456/930] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:36.401985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac524-5766-4db7-a5a7-3003c3fcf094 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.402541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac524-5766-4db7-a5a7-3003c3fcf094 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.403004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ac524-5766-4db7-a5a7-3003c3fcf094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.407157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878843b-f571-4a82-851c-242294774480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:36.407772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878843b-f571-4a82-851c-242294774480 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.408650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878843b-f571-4a82-851c-242294774480 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.408966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878843b-f571-4a82-851c-242294774480 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.409669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878843b-f571-4a82-851c-242294774480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:36.410047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878843b-f571-4a82-851c-242294774480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:36.411464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878843b-f571-4a82-851c-242294774480 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:36.431245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f32ac524-5766-4db7-a5a7-3003c3fcf094 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:36.431432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 475/931] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:36.431532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f32ac524-5766-4db7-a5a7-3003c3fcf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:36.432793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878843b-f571-4a82-851c-242294774480 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.453808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:36.517089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 457/932] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:36.553471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878843b-f571-4a82-851c-242294774480 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:36.576715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee19f-fa58-44e4-91b5-5ab2f7445c57 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.577026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee19f-fa58-44e4-91b5-5ab2f7445c57 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.577332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aee19f-fa58-44e4-91b5-5ab2f7445c57 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.582623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 458/933] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:36.584182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.584465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.584745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.589163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:36.589820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.590094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.590366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/e008960a52884d03a887c3f356021795/roles/69d4e4013a0a4892bff820ec2b11920d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.593721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=e008960a52884d03a887c3f356021795, role_id=69d4e4013a0a4892bff820ec2b11920d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:36.595160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:36.611612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:36.612870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:36.613407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 476/934] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:36 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/e008960a52884d03a887c3f356021795/roles/69d4e4013a0a4892bff820ec2b11920d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:31:36.681487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:36.693779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 459/935] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:36.806135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.890252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:36.917114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce3473-da7a-4be6-b359-c03a6c60d1a7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:36.957921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:36.958927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:36.959469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:36.959952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:36.960737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:36.962333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:36.963997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:36.973758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:36.974806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:31:36.975724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:36.978747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 477/936] 10.222.0.70 () {56 vars in 1132 bytes} [Wed Aug 31 10:31:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:36.984289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.092176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36ee32-b2c7-451e-9d0b-740d437a1848 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.107716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de157b-2068-40ea-867a-a90835e9e721 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.128399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.129051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.129324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.129588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.130208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:37.130514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.132337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.143024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 478/937] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:37.144551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.149393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:37.156978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.160115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.160824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.161782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.162868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.164770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:37.177669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:37.178742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:37.179593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:37.182695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 460/938] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:37.188309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.264043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:37.271097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63975e5c-bc55-461e-bf48-3e922779dd61 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.309579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.310555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.311124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.311687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.312515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:37.313050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.315461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.324794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c381075-cb7f-40a5-a141-d95a9b868cf8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.325514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 479/939] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:37.327617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.365844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.366518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.366797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.367076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.368133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:37.368463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.371753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.382656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 461/940] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:37.387843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.410606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:37.456587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb571a-35d1-4304-a6fe-cc51e6c75f1e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.499509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.500256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.500626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.500722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19278c-f70c-40cc-9ca8-ac154f49746e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.501084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.501910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.503847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db754741-55be-4941-be18-f7af3e78b4e7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.525976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 480/941] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:37.527161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09f14-b7a7-4006-9624-4e0618b6f1c3 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.527449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09f14-b7a7-4006-9624-4e0618b6f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.527775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd09f14-b7a7-4006-9624-4e0618b6f1c3 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.529152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 481/942] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:37.534582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:37.535276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.535880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.535880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.556417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:37.557662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:37.560121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.561081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.561364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.561637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.562282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:37.562587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.564114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.574953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 462/943] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:37.576474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.661246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 482/944] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:37.726386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af27e09-a4d3-490e-8f01-16b20cc586a9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.763761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.764371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.764648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.764949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.765664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] RBAC: Adding query filter params (interface=public, service_id=8856bfde32944e6898f30c1fad28f5ed, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:37.765980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.767965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.774531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 463/945] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:37 2022] GET /identity/v3/endpoints?service_id=8856bfde32944e6898f30c1fad28f5ed&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:37.780385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.841543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:37.888296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1cb0-d9c1-42f5-a021-fa36be3a7e12 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:37.922729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:37.923331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:37.924332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:37.924565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:37.925240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:37.926600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:37.932886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 483/946] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:37 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:31:37.938890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:37.996451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:38.058592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330583-3798-443d-9ea5-19a97ddc6a78 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:38.100794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:38.101405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:38.101679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:38.101946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:38.102602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:38.104041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:38.106694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING keystone.server.flask.common [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:31:38.126357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.sql.core [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:31:38.126357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:31:38.126357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [parameters: {'id': 'd985b8db3d7e4948b1048c3040b16f75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:31:38.126357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81677) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d985b8db3d7e4948b1048c3040b16f75.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d985b8db3d7e4948b1048c3040b16f75. Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:31:38.133532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 10:31:38.134383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application yield resource Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise self.value Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application session.commit() Aug 31 10:31:38.135378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:31:38.136286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:31:38.138411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application result.read() Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:31:38.140300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [parameters: {'id': 'd985b8db3d7e4948b1048c3040b16f75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:38.153450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:38.154683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d985b8db3d7e4948b1048c3040b16f75. Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:38.155796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 464/947] 10.222.0.70 () {60 vars in 1140 bytes} [Wed Aug 31 10:31:37 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:38.156476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:38.257820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b3f54-2c69-4ed2-9925-b5c9fac30d61 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:38.277115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:38.294874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:38.295502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:38.295780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:38.296048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:38.303228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:38.304672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-bee3c0cc-d366-4d42-bffb-6386ec4e00ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:38.316966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:38.318978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:38.321067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 484/948] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:38.328123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:38.439320 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:38.442736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb38ff5-a9f8-4f31-9300-ee9e453c4da9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:38.481769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:38.482388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:38.482671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:38.482943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:38.483615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:38.483917 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:38.485606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb32d3f-7708-48ae-b090-581577b31c78 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:38.508626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 465/949] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:38.631730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d10fa-6a4b-4280-88ce-6ebb9159faf9 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:38.632097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d10fa-6a4b-4280-88ce-6ebb9159faf9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:38.632278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d10fa-6a4b-4280-88ce-6ebb9159faf9 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:38.633939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 485/950] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:38.639552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:38.639839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:38.640123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:38.662986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:38.664530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:38.741325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 466/951] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:39.012844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d10fa-6a4b-4280-88ce-6ebb9159faf9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.120242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d10fa-6a4b-4280-88ce-6ebb9159faf9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:39.157651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:39.158861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.159140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.159472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.170931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:39.176602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:39.177565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:39.178439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 486/952] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:39.185751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.283429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:39.297896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4cc5-36b3-4d37-b909-e1c897ed7666 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:39.335505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:39.336919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.337426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.337898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.338759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:39.339269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:39.340855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:39.350084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 467/953] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:39.356569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.405954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:39.480284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21723815-1223-4f97-91be-b2ddd752951b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:39.516643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:39.517329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.517670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.517947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.529246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:39.530691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-8d24fb6c-4c97-4983-ac39-a9b8f26585e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:39.545426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:39.546669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:39.547947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:39.547947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:39.547947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:39.547947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 487/954] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:39.554039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.661479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a927-6722-4236-8b99-f0853a3a2754 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:39.698002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:39.698327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf41fbc-bfd4-435b-a17a-6b4a0b63b6c7 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.698327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf41fbc-bfd4-435b-a17a-6b4a0b63b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.698669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.698828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf41fbc-bfd4-435b-a17a-6b4a0b63b6c7 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.698991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.699140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.699739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:39.700044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:39.701288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 488/955] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:39.701556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:39.706126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.706408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.706680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.715251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 468/956] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:39.721255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.737437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:39.738730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:39.743571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:39.826869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 489/957] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:39.857677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb5c7-8f1b-4edd-9c53-9de480270459 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:39.893536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:39.894661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:39.895086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:39.895525 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:39.903363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:39.905008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-3265c835-b8dd-46dd-932c-28432956bf47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:39.917133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:39.918393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:31:39.919586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:39.921842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 469/958] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:39.927429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:39.950551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.036745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037077-8b0d-48c6-9c63-aadbedb0ff44 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.060385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b36d-e72b-4eac-99fc-b9aba2e95e2f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.060569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b36d-e72b-4eac-99fc-b9aba2e95e2f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.060730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b36d-e72b-4eac-99fc-b9aba2e95e2f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.062352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 470/959] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:40.068211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.068211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.068499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.077219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.078053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.078489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.078914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.079823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:40.080269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.082489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.087733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:40.088982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:40.105281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 490/960] 10.222.0.70 () {56 vars in 1149 bytes} [Wed Aug 31 10:31:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:40.113786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.164790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 471/961] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:40.165996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.168319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.213052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.244736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532265d-5c04-4a23-b808-1773d880c1e8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.288393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.289398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.289639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.290010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.292489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a472-cc43-473a-8256-7d7a624f86e4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.337942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.339647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.340310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.340725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.341467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.343714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:40.356414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:40.357716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:40.358747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:40.361982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 472/962] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:40.372198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.373578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.375032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.457098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.469916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.495912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 491/963] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:40.497156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.497489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65033a-45fb-430f-909c-9e5b3ce0624e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.544879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.545485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.545833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.546032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.546843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:40.546952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.548382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.554030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 473/964] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:40.559335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.601597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726446-37e5-4764-a256-e0df367ec5b6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.634317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.634946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.635220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.635485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.636064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.637447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:40.646535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:40.647584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:40.648445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 492/965] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:40.649308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.661634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689aa980-a76e-49b0-8ed1-903e1293a7d2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.690946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.691122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.697645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.698270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.698547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.698821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.709838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.711284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-1d31b7d8-f969-44dc-9819-37ca8457dd1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:40.725510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:40.726498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:40.727412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:40.727412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:40.727412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:40.727412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 474/966] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:40.728189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a634ad-bafb-4f7d-b319-3742b0132d98 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.728437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a634ad-bafb-4f7d-b319-3742b0132d98 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.728713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a634ad-bafb-4f7d-b319-3742b0132d98 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.729962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 475/967] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:40.730649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a634ad-bafb-4f7d-b319-3742b0132d98 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.753721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3e665-1f53-4baf-a323-bc34d07eb04c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.787900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.788506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.788832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.789211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.789840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:40.790139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.791509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.802631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 493/968] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:40.802631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:40.840299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a634ad-bafb-4f7d-b319-3742b0132d98 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.880304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.880870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.881149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.881477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.882124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:40.882435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.883837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef08a1e-3e7d-4f89-9b5c-666be6fc49df None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.889365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 476/969] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:40.895923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.896605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.897048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.918643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:40.919985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:40.933384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ebaf4-755f-43e0-951e-a3101fc4f8ea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:40.942537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.971802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:40.972778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:40.973279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:40.973750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:40.974581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:40.975055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:40.976583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:40.977315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:40.995801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 494/970] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:40.995801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.006146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 477/971] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:41.007000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.107833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dae5e-93d1-471c-88a8-684db147d2ea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.116254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a868d5a-a29b-47ae-a287-f6036ae88581 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.146632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.147581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.148166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.148671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.149571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:41.150071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.152029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.153938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.154575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.154854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.155128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.159203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 495/972] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:41.164426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.167786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.169276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:41.182319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:41.183265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:41.184624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:41.188053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 478/973] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:41.189058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.221259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:41.229049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:41.280932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b5db-55b2-41c4-86ae-b4ce78d8a134 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.303332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d266af6-c954-4a39-9f82-af3e81d44db5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.319263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.319959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.320237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.320523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.321200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.322558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.341555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.342715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.343164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.343270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 496/974] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:31:41.343649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.344110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.344654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:41.344993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.346652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.366777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 479/975] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:41.372932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.468986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:41.497838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edfe55-048a-4797-afe1-89ca1468ebc5 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.505213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:41.513839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c2a6-7089-4481-a66b-dc1a154c52a6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.551203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.552103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.552316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.553018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.553262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.554695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.557465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.557613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING keystone.server.flask.common [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:31:41.557942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.558315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.558680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.559498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] RBAC: Adding query filter params (role.id=69d4e4013a0a4892bff820ec2b11920d, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=e008960a52884d03a887c3f356021795) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:41.559902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.561539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.570266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 480/976] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:41 2022] GET /identity/v3/role_assignments?user.id=e008960a52884d03a887c3f356021795&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=69d4e4013a0a4892bff820ec2b11920d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:41.574951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.sql.core [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:31:41.574951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:31:41.574951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [parameters: {'user_id': '2796b7c1662544dda9145dbcb43c8835', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:31:41.574951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81678) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application result.read() Aug 31 10:31:41.593325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:31:41.594468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application yield resource Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise self.value Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application session.commit() Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:31:41.596165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:31:41.597450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:31:41.599137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application result.read() Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:31:41.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [parameters: {'user_id': '2796b7c1662544dda9145dbcb43c8835', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:41.603530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 10:31:41.607503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:41.609499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 497/977] 10.222.0.70 () {60 vars in 1131 bytes} [Wed Aug 31 10:31:41 2022] POST /identity/v3/users => generated 160 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:41.610326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.728939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e8d82-8c1d-4b6a-b91b-0b918f737982 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.772528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.773292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.773584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.773862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.784799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.786146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ca0821e0-0736-4653-a87c-345eaed4ee6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:41.799677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:41.800810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:41.802246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 481/978] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:41.807072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:41.913303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a524c-4acc-45e3-b231-5f80f8bfed5b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:41.951682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:41.952304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:41.952579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:41.952888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:41.953592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:41.953893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:41.956129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc3a90-1aff-4170-9c8d-76eac64006b0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:41.997694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 498/979] 10.222.0.70 () {56 vars in 1101 bytes} [Wed Aug 31 10:31:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:42.768963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4cdd-6ff3-4a1a-af32-859a47ca5f3d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:42.769747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4cdd-6ff3-4a1a-af32-859a47ca5f3d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:42.769857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f4cdd-6ff3-4a1a-af32-859a47ca5f3d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:42.771345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 482/980] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:42.776543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb200d1-1b0b-490f-9a5e-02963e5a42cf None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:42.776971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb200d1-1b0b-490f-9a5e-02963e5a42cf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:42.777131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb200d1-1b0b-490f-9a5e-02963e5a42cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:42.783958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:42.799071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4cb200d1-1b0b-490f-9a5e-02963e5a42cf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:42.802585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4cb200d1-1b0b-490f-9a5e-02963e5a42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:42.870391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 499/981] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:43.141362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f4cdd-6ff3-4a1a-af32-859a47ca5f3d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:43.166063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:43.252400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f4cdd-6ff3-4a1a-af32-859a47ca5f3d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:43.287503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:43.288103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:43.288380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:43.288650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:43.289336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:43.290764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f115-cd4a-48e0-b89c-7411d3a8739e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:43.308810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 483/982] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:43 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:43.468421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256af82-cec4-4d80-82a3-c2b9c6e8ed8d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:43.468733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256af82-cec4-4d80-82a3-c2b9c6e8ed8d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:43.468957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256af82-cec4-4d80-82a3-c2b9c6e8ed8d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:43.471238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 500/983] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:43.476447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:43.476743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:43.477052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:43.497213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:43.498413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:43.558674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5646-5d36-414f-8997-388e09f1f722 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:43.559013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5646-5d36-414f-8997-388e09f1f722 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:43.559210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d5646-5d36-414f-8997-388e09f1f722 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:43.560719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 501/984] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:43.566048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:43.566586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:43.566865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:43.577818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 484/985] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:43.585969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:43.587231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:43.658906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 502/986] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:43.865632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:43.874092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:43.926292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:43.975858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13d9be-c5fb-47aa-91dc-6740deeed5b5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:43.988132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:44.017779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.018653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.018930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.019456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.020038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.021441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.029440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f59104-6713-4465-93a6-7f2f665453e7 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:44.030072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:44.031040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:44.031905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 485/987] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:44.036989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.070326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.070905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.071154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.071477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.072005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.073403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:44.083759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:44.085027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:44.085886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 503/988] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 31 10:31:43 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:44.091819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.118843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:44.152935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c58d3-254b-4311-8269-f8bdc4912900 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.190922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.191523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.191800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.192065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.192680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:44.193004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.194402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.198984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4adc35-374b-4a72-a6b8-442d3924d6b4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.200921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 486/989] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:44.205573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.228747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:44.238697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.239755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.240476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.241209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.242014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:44.242493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.245044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.251967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 504/990] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:44.257530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.314343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54afc2-9c39-4c5c-b952-03711f081de3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.352220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.352850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.353135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.353399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.354022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:44.354324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.355684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.357096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:44.362751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 487/991] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:44.367532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb92c79-3e66-4715-8ac4-70310c8740c2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.367672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.405932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.406611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.407105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.408133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.409276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] RBAC: Adding query filter params (type=image) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:44.409471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.410944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.418407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 505/992] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:44.482748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f690f-42d8-4eab-9726-b9225ee18ed7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.521080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.521697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.521970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.522239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.522982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] RBAC: Adding query filter params (interface=admin, service_id=8856bfde32944e6898f30c1fad28f5ed, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:44.523293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.524685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d035-7eed-4685-a77f-ad809fa09847 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.530806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 488/993] 10.222.0.70 () {56 vars in 1249 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/endpoints?service_id=8856bfde32944e6898f30c1fad28f5ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:44.536752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:44.596817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:44.643515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1bb88-7848-451f-9dce-7d9df351a87c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:44.678068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:44.678671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:44.678946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:44.679215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:44.679815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:44.681199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064ce7b-b83e-45dd-8fac-e06cf1536119 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:44.696788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 506/994] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:44 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:31:45.291912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f538-aeed-4665-8dd3-83f6c351a2fe None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:45.292438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f538-aeed-4665-8dd3-83f6c351a2fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:45.292438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f538-aeed-4665-8dd3-83f6c351a2fe None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:45.293874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 489/995] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:45.299711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:45.300142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:45.300333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:45.318404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:45.319572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:45.388794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 507/996] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 31 10:31:45.661582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f538-aeed-4665-8dd3-83f6c351a2fe None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:45.727877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:45.777387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f538-aeed-4665-8dd3-83f6c351a2fe None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:45.817550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:45.818176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:45.818599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:45.818874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:45.819444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:45.820976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:45.829751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:45.830772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:45.833840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 490/997] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:45.837055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:45.887164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:45.939727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aec95c-e4f1-43b8-b5b4-7ac145711574 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:45.974029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:45.974937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:45.975402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:45.975848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:45.976640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:45.977137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:45.978665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:45.983545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 508/998] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:45.990080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:46.094680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b29ae5-8f1c-488e-a3ca-98dc6677ad52 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:46.121626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:46.132695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:46.133319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.133593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.133860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.134480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:46.134773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:46.136133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:46.146612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 491/999] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:46.147863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:46.255791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e0595-7ead-43d7-a7ba-fdd397c41288 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:46.269844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:46.293363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:46.293975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.294254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.294526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.295229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] RBAC: Adding query filter params (interface=public, service_id=13a79a108af448d49b54eb4f9ef61f12, region_id=RegionOne) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:46.295539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:46.296972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c37ba-d8bc-421f-bd8b-21f377bb1be5 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:46.307716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 509/1000] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:46 2022] GET /identity/v3/endpoints?service_id=13a79a108af448d49b54eb4f9ef61f12&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:46.309726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:46.354936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423d21-c9e4-4764-9002-10f3704c372e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.355219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423d21-c9e4-4764-9002-10f3704c372e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.355497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27423d21-c9e4-4764-9002-10f3704c372e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.357119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 510/1001] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:46.362995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192745b9-994f-4ea0-9fa0-64e7ce2ccecb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.363269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192745b9-994f-4ea0-9fa0-64e7ce2ccecb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.363535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192745b9-994f-4ea0-9fa0-64e7ce2ccecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.384306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-192745b9-994f-4ea0-9fa0-64e7ce2ccecb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:46.386332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-192745b9-994f-4ea0-9fa0-64e7ce2ccecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:46.421541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d7da4-7672-420d-9a59-74423747cc12 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:46.458031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:46.458699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.458911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.459184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.459767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:46.461391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ec4b1-5ead-4298-b646-32c0d9810241 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:46.461498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 511/1002] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:46.473183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 492/1003] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:46 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:31:46.608273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b3b3-707c-4f1f-90fa-1643d0a2ef08 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.608563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b3b3-707c-4f1f-90fa-1643d0a2ef08 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.608880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6b3b3-707c-4f1f-90fa-1643d0a2ef08 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.610230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 512/1004] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:46.615886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.616171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.616444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.635714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:46.636936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:46.690260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:46.710061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 493/1005] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:46.729208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6b3b3-707c-4f1f-90fa-1643d0a2ef08 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:46.849138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6b3b3-707c-4f1f-90fa-1643d0a2ef08 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:46.856794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:46.885443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:46.885964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:46.886239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:46.886553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:46.887192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:46.888608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:46.908790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 513/1006] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:46 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:46.978739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:47.090267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32889a8e-0879-4ace-8c35-33bcb791cd32 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:47.131269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:47.131908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:47.132187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:47.132459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:47.133341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:47.135188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:47.146734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:47.147830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:47.148707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 494/1007] 10.222.0.70 () {56 vars in 1126 bytes} [Wed Aug 31 10:31:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:47.153994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:47.259244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0591-632a-4469-9970-8c3a79b22192 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:47.292526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:47.293149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:47.293474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:47.293747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:47.294364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:47.294660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:47.296002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:47.305944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 514/1008] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:47.307164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:47.353690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:47.412381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ac642-dd1d-48f9-93c5-189cb9544a50 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:47.449142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:47.449753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:47.450030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:47.450299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:47.450929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:47.451232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:47.452598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c476-526b-4540-967a-b7c20b4e56cd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:47.458313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 495/1009] 10.222.0.70 () {56 vars in 1122 bytes} [Wed Aug 31 10:31:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:47.463768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:47.497152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:47.573486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ba188-9ffe-4214-8617-e5b2349a5c6f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:47.608286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:47.608920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:47.609202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:47.609475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:47.610146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:47.612534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27869581-ae43-4012-a487-8da5767807a9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:47.629350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 515/1010] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:48.403155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355e7-196c-4521-ab4a-33028b0e52f0 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:48.403705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355e7-196c-4521-ab4a-33028b0e52f0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:48.403705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a355e7-196c-4521-ab4a-33028b0e52f0 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:48.405109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 496/1011] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:48.410284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742bb1-2cbf-43b0-833c-f068ef33d009 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:48.410579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742bb1-2cbf-43b0-833c-f068ef33d009 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:48.410855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3742bb1-2cbf-43b0-833c-f068ef33d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:48.430162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a3742bb1-2cbf-43b0-833c-f068ef33d009 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:48.431454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a3742bb1-2cbf-43b0-833c-f068ef33d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:48.514912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 516/1012] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:48.783464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a355e7-196c-4521-ab4a-33028b0e52f0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:48.836462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5833f-c45b-4d66-84a7-a3ff38ceb545 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:48.836800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5833f-c45b-4d66-84a7-a3ff38ceb545 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:48.837038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5833f-c45b-4d66-84a7-a3ff38ceb545 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:48.838572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 517/1013] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:48.843348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:48.843628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:48.843898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:48.862542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:48.863742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:48.874304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:48.897709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a355e7-196c-4521-ab4a-33028b0e52f0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:48.909135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:48.937100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:48.937857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 518/1014] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:48 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:48.937984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:48.938063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:48.938339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:48.939626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:48.941027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:48.950183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:48.951152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:48.952018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 497/1015] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:48.957123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.056925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a0bd5-1b04-42d5-b3e2-e66908a470f3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.089987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.090594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.090868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.091137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.091757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:49.092056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.093447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.103497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 519/1016] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:49.104780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.209463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1386e-cec4-45c6-bcde-edc1eba72f15 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.218803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.232847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:49.246934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.247535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.247815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.248092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.248723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:49.249055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.250420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.256342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 498/1017] 10.222.0.70 () {56 vars in 1112 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:49.261798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.298572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:49.333934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429da80-bb98-405d-823e-d968cc36ea30 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.369910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.370810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.371090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.371366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.371939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.373327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:49.382823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:49.389039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:49.390153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 520/1018] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:49.390977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c55136-4fd4-4eca-a2b5-0d33fbc5d6c8 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.391060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.425639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.426243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.426529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.426769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.427481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.428815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15f20-114e-4f83-927e-2a33fef7dcca None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.457747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 499/1019] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:31:49.486043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:49.515745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a7a01-58fa-4a9c-98cf-9e9ffb387ca9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.561103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.561717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.561993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.562259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.562971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] RBAC: Adding query filter params (name=image) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:49.563322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.564700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e67b-cc0a-4f5d-b714-2a982c40a2b2 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.564859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.565034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e67b-cc0a-4f5d-b714-2a982c40a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.565315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387e67b-cc0a-4f5d-b714-2a982c40a2b2 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.567534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 500/1020] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:49.570373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 521/1021] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:49.573407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.573689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.573958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.576104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.595599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:49.596884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:49.680230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 501/1022] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:49.693368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3f9f0-1cc8-4002-9477-772afe986dbf None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.728850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.729462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.729738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.730008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.730634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] RBAC: Adding query filter params (type=image) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:49.730934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.732291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.733863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:49.738083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 522/1023] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:49.744175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.774577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:49.863080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67288f37-54c1-46bf-917a-4d1ff5618cb5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:49.898354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:49.899011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:49.899286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:49.899556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:49.900248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] RBAC: Adding query filter params (interface=public, service_id=36711881eeab403cb5e408d237bf3d2b, region_id=RegionOne) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:49.900551 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:49.901939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:49.907297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 502/1024] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/endpoints?service_id=36711881eeab403cb5e408d237bf3d2b&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:49.912711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:49.967265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:50.021531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e962a00-50b2-4006-b9bf-eb05f98fcd81 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:50.057719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:50.058325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:50.058602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:50.058870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:50.059476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:50.060893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:50.061030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:50.072793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 523/1025] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:31:50.087494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc738ae2-67a0-40a5-b107-7bf6bd647ba9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:50.131510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:50.132071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:50.132344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:50.132612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:50.134140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:50.135632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed3cd-b8a1-4b13-b5db-8e667dc9c19b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:50.137470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 503/1026] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:50.144547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:50.214360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:50.265433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709090ce-9b7e-425c-9817-529cde06692f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:50.299966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:50.300571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:50.300864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:50.301133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:50.301779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:50.303450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6bcdf8-4c82-4931-92b2-9ddbfbd2e4de None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:50.330606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 524/1027] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:31:50 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:31:51.526248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89266a4-1d39-4e9f-9c29-4881f4aa3234 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:51.526814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89266a4-1d39-4e9f-9c29-4881f4aa3234 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:51.526814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89266a4-1d39-4e9f-9c29-4881f4aa3234 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:51.528126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 504/1028] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:51.534082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce094b9-e56a-4f4a-a54e-24cd44bb25aa None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:51.534480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce094b9-e56a-4f4a-a54e-24cd44bb25aa None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:51.534648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce094b9-e56a-4f4a-a54e-24cd44bb25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:51.552536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7ce094b9-e56a-4f4a-a54e-24cd44bb25aa None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:51.553755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7ce094b9-e56a-4f4a-a54e-24cd44bb25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:51.619473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 525/1029] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:51.890331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89266a4-1d39-4e9f-9c29-4881f4aa3234 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:51.997344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89266a4-1d39-4e9f-9c29-4881f4aa3234 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.007310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e128-5242-4cc0-8793-b0acd237d960 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.007592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e128-5242-4cc0-8793-b0acd237d960 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.007869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0e128-5242-4cc0-8793-b0acd237d960 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.009494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 526/1030] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:52.014152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.014437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.014711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.034055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.034388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:52.034686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.034962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.035231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.035616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:52.046543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:52.051950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:52.052914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:52.053780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:52.058301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 505/1031] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:31:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:52.058975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.077000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.081367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.112066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 527/1032] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:52.168439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c015815-1f03-4ed7-be2e-941a0ccaf692 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.204590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.205213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.205489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.205756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.206404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:52.206701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.208056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681627a6-e032-4f8c-937f-2d08e9a5bb16 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.221403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 506/1033] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:52.222528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.281611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4f53-0cf9-4e71-8a9c-ec181b34b70e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.281890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4f53-0cf9-4e71-8a9c-ec181b34b70e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.282837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4f53-0cf9-4e71-8a9c-ec181b34b70e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.284199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 507/1034] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:52.290302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.290726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.290996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.308945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:52.310054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:52.332978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dcadf-4681-4797-9d07-c4404db901d0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.367494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.368122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.368399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.368671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.377226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 508/1035] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:52.382312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.382448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.383841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.390313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:52.403271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:52.404269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:52.405516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:52.405516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:52.405516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:52.405516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 528/1036] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:52.411531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.440837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.490812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc56da-3c0e-47c7-8490-3cdf5e629794 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.517533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9525b3b-dd15-4de3-a8c0-a3a742d5067b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.529422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.530058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.530341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.530770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.531361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.533790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:52.546245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:52.547265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:52.553254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 509/1037] 10.222.0.70 () {56 vars in 1105 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:52.554097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.556626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.557265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.557527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.557924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.558569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:52.558867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.560271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.572720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 529/1038] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:52.578203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.634581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.666818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.669078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40170d7-5fe1-4d34-871e-ac2b57f932e0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.682233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c7723-f632-4888-85aa-4ccafb8ce7ac None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.703891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.705284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.705570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.705843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.706469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] RBAC: Adding query filter params (name=image) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:52.706772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.708140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.712990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 510/1039] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:52.717340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.717970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.718246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.718451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.718552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.725712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.727439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:52.738997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:52.740146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 530/1040] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:52.741152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.823116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef656ee7-f107-4b18-9832-c9de272ade46 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.842229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa7a1-71ca-45e6-9801-6766c575ac71 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.857594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.858245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.858527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.858802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.859905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.862097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.863664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 511/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:52.864423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.867129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.875873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:52.877014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:52.877288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:52.877553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:52.878177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] RBAC: Adding query filter params (type=image) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:52.878472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:52.879819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:52.884508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 531/1042] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:52.885281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:52.899209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:52.968834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8e23-b9cf-4667-982e-1509179c6453 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:52.987012 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe39576-7972-4907-953f-a96ef5123c8e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.004414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.005036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.005314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.005586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.006302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:53.006606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.008030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.020613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.021232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.021505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.021768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.022406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.023813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.025853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 512/1043] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:53.026561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.064791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 532/1044] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:31:52 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:53.064791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.093990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:53.128684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:53.143493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb552cc-cf76-4428-8f33-827c715c55f1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.174448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4074-fda3-4713-a7ad-89cefa576e78 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.185173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.186114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.186565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.186845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.187571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.189911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.215807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.215807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.216139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.216139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.217250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 513/1045] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:31:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:31:53.305040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.306556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.380198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:53.417612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 533/1046] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:53 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:53.423896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.535481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0014db-c143-40a1-a13b-91b6b5c4eb07 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.548889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:53.572961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.573858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.574277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.574685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.586356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.588018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:53.602857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:53.603905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:53.604836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:53.604836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:53.604836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:53.608832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 514/1047] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:53.611245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.718176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fe2-e717-4a62-9b0c-50a4c63bbcc9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.753507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.754107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.754384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.754653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.755288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:53.755588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.756978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.768295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 534/1048] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:53.774558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.882746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cd79f-f1b0-44aa-b554-2cdbc328d2ed None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:53.916359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:53.917022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:53.917300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:53.917571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:53.924878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:53.926325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:53.937809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:53.939249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:53.940156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:53.944374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 515/1049] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:53.945821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:53.973931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:54.048700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4acc-21e1-4793-ba3e-a10c9b589d2c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:54.081403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:54.082000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:54.082272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:54.082541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:54.083217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:54.083518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:54.084958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312c61f-d587-43ce-9a6d-501da4bb161a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:54.102920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 535/1050] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:54.104523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:54.133100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:54.215063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5e70a-30b7-462e-9ea8-f0b16d286f6e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:54.252348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:54.252912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:54.253194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:54.253470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:54.254216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] RBAC: Adding query filter params (role.id=69d4e4013a0a4892bff820ec2b11920d, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:54.254534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:54.256012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3abb0-35d1-4c5e-a838-f92314cc17c1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:54.262486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 516/1051] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:54 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=69d4e4013a0a4892bff820ec2b11920d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:55.138400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85b7b-7d9f-4027-a405-3a34cc0531a6 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.138922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85b7b-7d9f-4027-a405-3a34cc0531a6 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.138999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad85b7b-7d9f-4027-a405-3a34cc0531a6 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.140324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 536/1052] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:55.147106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.147549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.147775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.166843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:55.168022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:55.172197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1bb30-9d50-4c44-8c62-7e3856309f52 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.172474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1bb30-9d50-4c44-8c62-7e3856309f52 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.172879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1bb30-9d50-4c44-8c62-7e3856309f52 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.174339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 537/1053] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:31:55.179120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.179395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.179666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.198499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:55.200360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:55.249372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 517/1054] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:55.279309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 538/1055] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:55.519988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:55.539237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:55.545567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:55.564357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:55.631921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb775c-7dbf-4137-b9b9-5c70c5463f04 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:55.650762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638aad3-2239-4609-a694-0a6baa82126b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:55.668058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:55.668683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.669068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.669334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.680220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:55.685060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:55.685990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:55.686843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 518/1056] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:55.689915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:55.690780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.691247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.691748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.692747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:55.771293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:55.772687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:55.774522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:55.796223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:55.802639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec03a-de30-4cc5-8623-2ebcecadd9ff None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:55.836440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:55.837068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.837349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.837621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:55.838277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:55.838590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:55.839973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:55.849060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 519/1057] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:55.854756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:55.895160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 539/1058] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:31:55.901346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:55.961648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012e80d-8b01-4032-aa02-d91265ebe42b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:55.997947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:55.998676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:55.998951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:55.999231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] PATH_INFO: `/v3/users/5a17c7af75cf45d193027210151f24aa` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.001427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c363a8-90a3-4d59-be81-909d465436e4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.010267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.014826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] RBAC: Authorizing `identity:get_user(user_id=5a17c7af75cf45d193027210151f24aa)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.016851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.018585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 520/1059] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:31:55 2022] GET /identity/v3/users/5a17c7af75cf45d193027210151f24aa => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:56.024229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.026073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.045436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.046060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.046334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.046598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.057309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.058743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:56.073568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:56.074732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:56.075628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:56.075628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:56.075628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:56.075628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 540/1060] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:56.081307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.136579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81238ce8-5cb0-4f5f-b306-ce1a5ed80f14 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.174979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.175641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.175842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.176116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.183449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f6cf5-66d7-4810-ab7d-e5acb69f7631 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.216078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.216670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.216984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.217256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.217882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:56.218180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.219731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ba73f-f5f0-4f36-82d4-d63d5d052b50 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.232315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 541/1061] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:31:56.233349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9854-d7d1-454c-a1d7-84224f29f1bd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.233630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9854-d7d1-454c-a1d7-84224f29f1bd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.233899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9854-d7d1-454c-a1d7-84224f29f1bd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.235635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 542/1062] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:56.241220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.241501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.241775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.253881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.258535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.260030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.264450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:56.265936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:56.296811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.354325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 543/1063] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:31:56.383066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 521/1064] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:31:56.389954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.498364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd84e7-baf3-498a-ae1e-a170bef00aa3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.534828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.535462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.535742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.536015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.537175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.538604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.540547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 544/1065] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:56.546537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.621668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.643697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.648062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b62be4-58f7-4350-8d13-b4b8dd6a3e48 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.649301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:56.683554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.684151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.684430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.684697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.685444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=e81c74e9d71347a6a188cae927156111, user.id=5a17c7af75cf45d193027210151f24aa) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:56.685754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.687182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.692582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 522/1066] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/role_assignments?user.id=5a17c7af75cf45d193027210151f24aa&scope.project.id=e81c74e9d71347a6a188cae927156111&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:56.725292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c341a-1c94-439e-be3f-7efa6505f3f0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.761247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.762056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.762328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.762612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.775125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:56.780090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:56.781269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:56.782842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 545/1067] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:56.788035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:56.889578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8a35e-e40f-4c83-ac0e-e92933f40cf7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:56.922169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:56.923281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:56.923552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:56.923817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:56.924465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:56.924780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:56.926143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:56.933891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 523/1068] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:56.940088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.022762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:57.038051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b0f43-d4d9-4be3-a94f-98708e48f1b8 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.071024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.071643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.071918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.072184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.081949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.083383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:57.098003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:57.099099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:57.100115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:57.100115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:57.100115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:57.100115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 546/1069] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:57.104820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.130480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:57.208789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068eda-cc81-4d3e-9502-4487caf6f54d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.242452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.243055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.243336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.243610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.244247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:57.244550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.245956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.257584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 524/1070] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:57.263188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.362163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bae75-0dd1-4d67-b5fd-967f7fd361af None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.395216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.395834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.396113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.396383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.404220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.405683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.408063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:31:57.418291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:57.419424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:57.420707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 547/1071] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:57.425452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.511431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:57.528115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388c918-3245-414f-8068-33bfa85c1d57 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.561673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.562273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.562550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.562821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.563678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:57.563983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.565442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.582991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 525/1072] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:57.588605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.686345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5033-5011-4bec-88d1-d51685ae7652 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.720317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.721074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.721355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.721627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.732113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.733571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:31:57.747824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:57.748917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:31:57.751372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:31:57.751372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:31:57.751372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:57.751372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 548/1073] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:57.755602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.861138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762fae-49a3-4927-b399-c3c20f6a99f0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:57.896248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:57.896943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:57.897163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:57.897434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:57.898075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:57.898376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:57.899748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:57.911501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 526/1074] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:57.917163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:57.966402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:58.015913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42791-b7ca-4a3c-bc1d-04be63d9efe9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:58.049301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:58.049919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:58.050197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:58.050463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:58.057111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:58.058488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:31:58.070136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:58.071158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:31:58.072465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 549/1075] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:31:58.077131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:58.080752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:58.177294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8cbe1-e597-4bbe-ab2c-293ab5e40d24 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:58.210379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:58.211018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:58.211240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:58.211508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:58.212192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:58.212493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:58.213954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb9e5e-4a32-4ab2-bd2b-e9cd9e33c605 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:58.227104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 527/1076] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:58.233018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:58.333525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c8b3-8c2d-458c-bdf3-46c95dccfe6d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:58.344272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:58.367529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:58.368176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:58.368455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:58.368724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/69d4e4013a0a4892bff820ec2b11920d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:58.370847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=211155364dfd4a60bc13efa3c7d7fa98, role_id=69d4e4013a0a4892bff820ec2b11920d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:58.372263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c3af3-fd55-4914-993a-0964f5939946 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:58.385084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 550/1077] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:58 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/211155364dfd4a60bc13efa3c7d7fa98/roles/69d4e4013a0a4892bff820ec2b11920d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:31:58.631069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dd3e-693d-4ea2-9022-333f80c1f931 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:58.631356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dd3e-693d-4ea2-9022-333f80c1f931 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:58.631634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400dd3e-693d-4ea2-9022-333f80c1f931 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:58.633022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 528/1078] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:31:58.638339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:58.638625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:58.638900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:58.657855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:31:58.659088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:31:58.724041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 551/1079] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:31:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:31:58.989865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400dd3e-693d-4ea2-9022-333f80c1f931 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:59.051384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:59.090291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400dd3e-693d-4ea2-9022-333f80c1f931 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:59.123091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:59.123704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:59.123983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:59.124261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:59.135609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:31:59.140436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:31:59.141733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:31:59.143387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 529/1080] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:31:59.148107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:59.242907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:59.246224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543b6f2-78dc-4e69-9a73-b937c3b10542 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:59.281526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:59.282725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:59.283001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:59.283271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:59.283925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:31:59.284224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:59.285615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:59.293470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 552/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:31:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:59.300256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:59.403852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f2eb4-b034-4b5c-b038-d4ec4ef4ab80 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:59.427769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:31:59.440036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e366a-d652-45aa-af78-76157558476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:59.440690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e366a-d652-45aa-af78-76157558476c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:59.440993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e366a-d652-45aa-af78-76157558476c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:59.441263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e366a-d652-45aa-af78-76157558476c None admin] PATH_INFO: `/v3/users/5a17c7af75cf45d193027210151f24aa` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:59.442544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e366a-d652-45aa-af78-76157558476c None admin] RBAC: Authorizing `identity:get_user(user_id=5a17c7af75cf45d193027210151f24aa)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:59.443916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e366a-d652-45aa-af78-76157558476c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:59.445903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 530/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:31:59 2022] GET /identity/v3/users/5a17c7af75cf45d193027210151f24aa => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:59.451395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:59.550862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21a07e-fa20-4e20-80a0-4bb99fbf5d77 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:59.582355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:59.582967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:59.583240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:59.583506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:59.584596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:59.586103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d0659-c068-4f50-80f5-bf150382c23c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:59.587910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 553/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:31:59 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:31:59.593653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e366a-d652-45aa-af78-76157558476c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:31:59.692628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e366a-d652-45aa-af78-76157558476c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:31:59.726710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:31:59.727346 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:31:59.727619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:31:59.727887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111/users/5a17c7af75cf45d193027210151f24aa/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:31:59.729800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] RBAC: Authorizing `identity:create_grant(project_id=e81c74e9d71347a6a188cae927156111, user_id=5a17c7af75cf45d193027210151f24aa, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:31:59.731222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0fd0c-af47-4ea0-b6f8-91f813a06897 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:31:59.743692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 531/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:31:59 2022] PUT /identity/v3/projects/e81c74e9d71347a6a188cae927156111/users/5a17c7af75cf45d193027210151f24aa/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:32:00.286398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd756a9-0e1e-43f1-b76e-2b3c0fcd5633 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:00.286677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd756a9-0e1e-43f1-b76e-2b3c0fcd5633 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:00.286950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd756a9-0e1e-43f1-b76e-2b3c0fcd5633 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:00.288441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 554/1085] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:32:00.293280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:00.293567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:00.293839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:00.312445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:00.314630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:00.360687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:00.384044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 532/1086] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:00.659025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd756a9-0e1e-43f1-b76e-2b3c0fcd5633 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:00.689944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:00.761088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd756a9-0e1e-43f1-b76e-2b3c0fcd5633 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:00.795291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:00.795940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:00.796213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:00.796480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:00.808850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:00.814325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:00.816858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:00.817876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 555/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Wed Aug 31 10:32:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:00.821610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:00.919224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9335-5b41-4f2f-8719-3b727ea5bd76 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:00.952187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:00.952799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:00.953080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:00.953350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:00.954599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:00.954897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:00.956268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:00.964157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 533/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:32:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:00.969780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.057449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:01.067795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9a99-9925-4a21-bc0a-42f55f9d34ae None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:01.100962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:01.101584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.101863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.102138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.113191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:01.114631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:32:01.129379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:01.130491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:32:01.131421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:32:01.131421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:32:01.131421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:01.131421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 556/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:01.136459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.184175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:01.241670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc669055-930c-42d7-8f9b-2b3df09cd9fe None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:01.275287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:01.275912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.276191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.276462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.277129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:01.277430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:01.278796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:01.290567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 534/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:01.296137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.396164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45eaab-142e-439e-9b12-82e081be6a65 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:01.429021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:01.429638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.429913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.430180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.437362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:01.439285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:32:01.450223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:01.451266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:01.452262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 557/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:01.457521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.557910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477ad4-abe7-4f37-a600-6ef66854202b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:01.559440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:01.593058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:01.593663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.593940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.594723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.595528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:01.595834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:01.597279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c53b7-39b0-443f-9517-2fef80ec5d41 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:01.614799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 535/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:01.620616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.623574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:01.629193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e3c07-f3f2-400c-afa8-b19d207c8ebe None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.629479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e3c07-f3f2-400c-afa8-b19d207c8ebe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.629754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e3c07-f3f2-400c-afa8-b19d207c8ebe None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.631084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 536/1093] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:32:01.635867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.636143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.636413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.654359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:01.655541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:01.723745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2814413-f418-4ec6-8167-6a4d00e23049 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:01.724384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 537/1094] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:32:01.757134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:01.757727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:01.757997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:01.758261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:01.829387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:01.830959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:01.832734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:01.927328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 558/1095] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:01.933215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:01.998308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.023033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.034092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127dbd-5de9-4094-b8a8-51884048b7f8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.070210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.070840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.071122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.071394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.081837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.083293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.098418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c599d2-f0e0-49d3-8dc2-7adc9122755c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:32:02.098558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:02.099651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:32:02.100571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:32:02.100571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:32:02.100571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:02.100571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 538/1096] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:02.105185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.105960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.135557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.136183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.136465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.136746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.147514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:02.152346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:02.153379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:02.154792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 559/1097] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:32:02.159889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.205633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07052ec-04ad-44b7-808d-69764fb409d5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.239526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.240124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.240400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.240667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.241372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:02.241673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.243028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.255378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 539/1098] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:02.260640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ed47-6291-4528-9d16-1aaaea3d6a97 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.260966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.263490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.296611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.297855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.298135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.298409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.299071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:02.299371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.300737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.308861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 560/1099] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:02.314940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.338938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.361477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e3f6b-5b76-449e-abb9-549a48198b4c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.395304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.395927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.396201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.396469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.402957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.404393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.415738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dbc73-2b73-4e0f-9db8-7d8de8716595 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:32:02.415888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:02.417048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:02.418157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 540/1100] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:32:02.425314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.449041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.449666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.449969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.450236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] PATH_INFO: `/v3/users/5a17c7af75cf45d193027210151f24aa` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.451349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] RBAC: Authorizing `identity:get_user(user_id=5a17c7af75cf45d193027210151f24aa)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.452797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.454377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 561/1101] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/users/5a17c7af75cf45d193027210151f24aa => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:02.460001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.486391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.526825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b06d-438f-4810-995e-2415b99443b6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.549862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.558543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba27a94-9068-4013-9bf2-40601b8fd57b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.561801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.562553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.563482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.563928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.564730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:02.565171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.566774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.585816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 541/1102] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:02.591881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.598931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.599532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.599808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.600086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.668775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.670220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.692626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebc458-4a4f-4237-8736-a168eba5ad48 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.714273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.726689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.727270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.727541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.727806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.728517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] RBAC: Adding query filter params (role.id=69d4e4013a0a4892bff820ec2b11920d, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=211155364dfd4a60bc13efa3c7d7fa98) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:02.728853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.730266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.736357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 542/1103] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/role_assignments?user.id=211155364dfd4a60bc13efa3c7d7fa98&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=69d4e4013a0a4892bff820ec2b11920d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:02.761385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:02.772136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 562/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:32:02.778394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:02.889522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07816eb-b21c-400f-a955-765ea39d5e4a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:02.923801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:02.924418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:02.924693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:02.924998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:02.926112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:02.927548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88f6c0-8d89-4768-b95e-d0c01a1690fa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:02.929212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 543/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:02.935304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:03.036916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc8b64-876c-4cbe-81af-c97106ba8626 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:03.071540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:03.072135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:03.072410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:03.072681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:03.073436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=e81c74e9d71347a6a188cae927156111, user.id=5a17c7af75cf45d193027210151f24aa) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:03.073740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:03.075161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85522053-579d-45b8-aa86-82bab0cfdfd0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:03.080983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 563/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:02 2022] GET /identity/v3/role_assignments?user.id=5a17c7af75cf45d193027210151f24aa&scope.project.id=e81c74e9d71347a6a188cae927156111&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:05.029023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e412-c3f5-4838-94ab-fe1547296638 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:05.029644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e412-c3f5-4838-94ab-fe1547296638 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:05.029644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9e412-c3f5-4838-94ab-fe1547296638 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:05.030905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 544/1107] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:05.036052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:05.036500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:05.036604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:05.054803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:05.055899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:05.103921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:05.121159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 564/1108] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:05.403213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9e412-c3f5-4838-94ab-fe1547296638 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:05.459810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:05.505831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9e412-c3f5-4838-94ab-fe1547296638 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:05.541226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:05.541843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:05.542115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:05.542378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:05.543470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:05.544976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6de3a-eaf1-43de-82bb-65eb62478d74 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:05.546887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 545/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:05.552976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:05.653793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411bf7c-9ec1-4e89-a291-9fe3cadff20d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:05.687387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:05.688034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:05.688307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:05.688570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:05.689327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:05.690741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9cdf0-14ec-4a6a-9597-33f6b0e059c6 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:05.715247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 565/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:32:05 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:07.657937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57815cb-b97e-47d2-aa11-bbb93d3c1c6b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:07.658501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57815cb-b97e-47d2-aa11-bbb93d3c1c6b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:07.658501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57815cb-b97e-47d2-aa11-bbb93d3c1c6b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:07.659803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 546/1111] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:07.664914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:07.665296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:07.665469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:07.684005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:07.685213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:07.720191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:07.752153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 566/1112] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:08.025029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57815cb-b97e-47d2-aa11-bbb93d3c1c6b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:08.122574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57815cb-b97e-47d2-aa11-bbb93d3c1c6b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:08.144672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:08.156295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:08.157072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:08.157338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:08.157603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] PATH_INFO: `/v3/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:08.158969 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] RBAC: Authorizing `identity:get_role(role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:08.160321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:08.161645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 547/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:08 2022] GET /identity/v3/roles/b5722621e10c4e1694a7eebeec0084eb => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:08.167453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:08.265276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc969837-38d7-4182-9b1f-0a4cb4442936 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:08.298873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:08.299424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:08.299701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:08.299973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] PATH_INFO: `/v3/users/eed3b029fb5a49fc81de7414a5d18164` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:08.312380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=eed3b029fb5a49fc81de7414a5d18164)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:08.313842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:08.315399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 567/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:08 2022] GET /identity/v3/users/eed3b029fb5a49fc81de7414a5d18164 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:08.321333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:08.417843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41737f-4faa-4453-897b-de01d740162d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:08.450725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:08.451312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:08.451591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:08.451861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:08.507519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:08.518032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:08.519720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:08.614488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 548/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:08.620326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:08.650206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:08.719466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37cae1-8d08-4bd6-815d-7d7d66511ac9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:08.751690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:08.752306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:08.752579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:08.752878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:08.753982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:08.755404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f4b93-6ef8-496d-b13c-14a54dcae1dd None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:08.757046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 568/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:08 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:08.763305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:08.850811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:08.860422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb3f5f-cc9b-402f-ae76-87e11fbb719d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:08.893279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:08.894063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:08.894341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:08.894609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:08.895316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=e81c74e9d71347a6a188cae927156111, user.id=eed3b029fb5a49fc81de7414a5d18164) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:08.895619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:08.897060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c4cb1-6f46-4a68-a7ff-affa6291702e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:08.902217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 549/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:08 2022] GET /identity/v3/role_assignments?user.id=eed3b029fb5a49fc81de7414a5d18164&scope.project.id=e81c74e9d71347a6a188cae927156111&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:10.773634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32f22-abe6-45de-b123-cd4942b69ac0 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:10.774190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32f22-abe6-45de-b123-cd4942b69ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:10.774190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d32f22-abe6-45de-b123-cd4942b69ac0 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:10.775506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 569/1118] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:10.780490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:10.780911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:10.781073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:10.800049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:10.801265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:10.866915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 550/1119] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:11.131937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32f22-abe6-45de-b123-cd4942b69ac0 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:11.226769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:11.231685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d32f22-abe6-45de-b123-cd4942b69ac0 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:11.265463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:11.266350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:11.266447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:11.266715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] PATH_INFO: `/v3/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:11.268093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] RBAC: Authorizing `identity:get_role(role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:11.269742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:11.271031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 570/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:11 2022] GET /identity/v3/roles/b5722621e10c4e1694a7eebeec0084eb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:11.276731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:11.356572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:11.371918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f811fd-c393-4440-b605-fb1c3d31cca2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:11.405400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:11.405951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:11.406943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:11.407227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] PATH_INFO: `/v3/users/eed3b029fb5a49fc81de7414a5d18164` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:11.408316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] RBAC: Authorizing `identity:get_user(user_id=eed3b029fb5a49fc81de7414a5d18164)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:11.409765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:11.411318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 551/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:11 2022] GET /identity/v3/users/eed3b029fb5a49fc81de7414a5d18164 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:11.417006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:11.516395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5aa93-e6c4-44d1-809b-1637f2a984b2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:11.549645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:11.550256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:11.550531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:11.550799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:11.551887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:11.553334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360dc22-9cda-457c-a278-3cccc6b2eb43 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:11.554924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 571/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:11 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:11.560821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:11.656972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f677bb-a0b4-4bd1-ad3f-efa0c19074dd None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:11.689590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:11.690229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:11.690509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:11.690782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111/users/eed3b029fb5a49fc81de7414a5d18164/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:11.692921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] RBAC: Authorizing `identity:create_grant(project_id=e81c74e9d71347a6a188cae927156111, user_id=eed3b029fb5a49fc81de7414a5d18164, role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:11.694350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdcc91-37b2-43de-9462-57df4756e327 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:11.707142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 552/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:32:11 2022] PUT /identity/v3/projects/e81c74e9d71347a6a188cae927156111/users/eed3b029fb5a49fc81de7414a5d18164/roles/b5722621e10c4e1694a7eebeec0084eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:32:13.594920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817417-b9e8-4913-abab-68742f6b8299 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:13.595450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817417-b9e8-4913-abab-68742f6b8299 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:13.595450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63817417-b9e8-4913-abab-68742f6b8299 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:13.596955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 572/1124] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:13.601857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:13.602256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:13.602396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:13.620062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:13.621259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:13.628786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:13.688222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 553/1125] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:13.973106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817417-b9e8-4913-abab-68742f6b8299 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:14.010312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:14.077383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63817417-b9e8-4913-abab-68742f6b8299 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:14.111495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:14.112106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:14.112385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:14.112660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] PATH_INFO: `/v3/roles/b5722621e10c4e1694a7eebeec0084eb` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:14.114112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] RBAC: Authorizing `identity:get_role(role_id=b5722621e10c4e1694a7eebeec0084eb)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:14.115471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:14.116782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 573/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:13 2022] GET /identity/v3/roles/b5722621e10c4e1694a7eebeec0084eb => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:14.122673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:14.218203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517460c4-023e-444f-88aa-3b698c5c4243 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:14.252720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:14.253305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:14.253585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:14.253856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] PATH_INFO: `/v3/users/eed3b029fb5a49fc81de7414a5d18164` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:14.254965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] RBAC: Authorizing `identity:get_user(user_id=eed3b029fb5a49fc81de7414a5d18164)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:14.256390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:14.257975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 554/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:14 2022] GET /identity/v3/users/eed3b029fb5a49fc81de7414a5d18164 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:14.263835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:14.361837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4c2a-dde1-4bbe-b375-cb8d23246c5a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:14.363353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:14.395534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:14.396122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:14.396398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:14.396667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:14.460384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:14.461823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:14.557432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 574/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:14.563352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:14.576744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:14.662899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f60f32-3328-44e6-8201-41c97fd3c270 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:14.695172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:14.695777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:14.696048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:14.696312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] PATH_INFO: `/v3/projects/e81c74e9d71347a6a188cae927156111` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:14.697421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] RBAC: Authorizing `identity:get_project(project_id=e81c74e9d71347a6a188cae927156111)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:14.698838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edeef-e3cb-4887-9624-251e93199539 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:14.700440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 555/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:14 2022] GET /identity/v3/projects/e81c74e9d71347a6a188cae927156111 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:32:14.707301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:14.709489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:14.806552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb343da4-ac0b-4a22-9d95-1c971b8b60ca None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:14.839473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:14.840065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:14.840342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:14.840610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:14.841349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] RBAC: Adding query filter params (role.id=b5722621e10c4e1694a7eebeec0084eb, scope.project.id=e81c74e9d71347a6a188cae927156111, user.id=eed3b029fb5a49fc81de7414a5d18164) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:14.841652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:14.843069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbecc22-67bc-4ff6-b930-52ab4605c9f4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:14.849354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 575/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:14 2022] GET /identity/v3/role_assignments?user.id=eed3b029fb5a49fc81de7414a5d18164&scope.project.id=e81c74e9d71347a6a188cae927156111&role.id=b5722621e10c4e1694a7eebeec0084eb => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:16.870743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb26a4c-8b68-40ff-b9b7-d3c7f8131bfd None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:16.871245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb26a4c-8b68-40ff-b9b7-d3c7f8131bfd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:16.871358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb26a4c-8b68-40ff-b9b7-d3c7f8131bfd None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:16.872635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 556/1131] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:16.878292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:16.878664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:16.878841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:16.897095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:16.898272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:16.955284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:16.963019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 576/1132] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:17.233317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb26a4c-8b68-40ff-b9b7-d3c7f8131bfd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:17.312304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:17.334323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb26a4c-8b68-40ff-b9b7-d3c7f8131bfd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:17.367988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:17.368602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:17.368907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:17.369179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:17.370270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:17.371701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2e48-a67a-4c02-8c90-9c859ac64a87 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:17.373272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 557/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:17.379051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:17.474158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc452-d259-4801-8998-d56c64f0a9df None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:17.507138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:17.507672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:17.507951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:17.508224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:17.508897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:17.510315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43858f2-0eac-491f-8116-2fd39f49b789 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:17.536990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 577/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:32:17 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:19.526775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb7ee-d688-4e89-beb0-85963f25ee85 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:19.527328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb7ee-d688-4e89-beb0-85963f25ee85 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:19.527328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adb7ee-d688-4e89-beb0-85963f25ee85 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:19.528648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 558/1135] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:19.534928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:19.535336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:19.535492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:19.554362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:19.555572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:19.600530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:19.625282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 578/1136] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:19.900784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb7ee-d688-4e89-beb0-85963f25ee85 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:20.028598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adb7ee-d688-4e89-beb0-85963f25ee85 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:20.062479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:20.063026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:20.063299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:20.063564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:20.064680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:20.066124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44da9b4-f88a-43ce-b0fb-2fabf13fa188 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:20.067679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 559/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:20.073466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:20.169217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13df3e-f45e-4727-9f62-3daab49d3c25 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:20.201116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:20.201704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:20.201975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:20.202239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:20.203419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:20.204842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39175e8b-36f2-4356-8a01-56b6447ee948 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:20.225424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 579/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:32:20 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:22.164182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e66c6-60e2-424f-afcf-6e13f7b08135 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:22.164734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e66c6-60e2-424f-afcf-6e13f7b08135 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:22.164734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e66c6-60e2-424f-afcf-6e13f7b08135 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:22.166138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 560/1139] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:22.171147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:22.172122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:22.172471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:22.190728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:22.191887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:22.217082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:22.256411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 580/1140] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:22.533178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e66c6-60e2-424f-afcf-6e13f7b08135 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:22.549451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:22.632214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e66c6-60e2-424f-afcf-6e13f7b08135 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:22.666212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:22.666827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:22.667103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:22.667373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:22.678077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:22.682855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:22.684003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:22.685135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 561/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:22.689947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:22.786782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efffe5f-28fd-436c-bae2-02b0c52c0a1b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:22.819869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:22.820473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:22.820748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:22.821051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:22.821699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:22.821996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:22.823345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:22.831277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 581/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:22.837107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:22.911148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:22.934864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291c842-0c3f-46b6-9028-d7eacde3506c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:22.967984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:22.968824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:22.969080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:22.969349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] PATH_INFO: `/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:22.982547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] RBAC: Authorizing `identity:get_user(user_id=00d5f8fb75b64306ac0eb5c6d75c5c95)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:22.984622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:22.986235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 562/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:22 2022] GET /identity/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:22.992124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:23.019871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:23.090769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050f52-ed3a-450c-a8a7-790fa28cdd37 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:23.123128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:23.123723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:23.123999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:23.124266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:23.190155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:23.191723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:23.217308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:23.289109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 582/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:23.295065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:23.391560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535acf6d-233f-4a9f-bb98-9a3471778598 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:23.420260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:23.426050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:23.426667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:23.426941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:23.427208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] PATH_INFO: `/v3/projects/041843f397054b8ab2fcb4c5d90067c3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:23.428328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] RBAC: Authorizing `identity:get_project(project_id=041843f397054b8ab2fcb4c5d90067c3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:23.429786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95e1e4-a9d9-4670-b9ca-e6a3e2212f1d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:23.431397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 563/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:23 2022] GET /identity/v3/projects/041843f397054b8ab2fcb4c5d90067c3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:23.437552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:23.531996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdab16-9814-4e1a-af77-067f7a97d3a4 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:23.556401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:23.565456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:23.566042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:23.566319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:23.566590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:23.567305 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=041843f397054b8ab2fcb4c5d90067c3, user.id=00d5f8fb75b64306ac0eb5c6d75c5c95) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:23.567607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:23.569040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231b492-92fe-45dc-832e-1fcc5eebb143 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:23.574196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 583/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:23 2022] GET /identity/v3/role_assignments?user.id=00d5f8fb75b64306ac0eb5c6d75c5c95&scope.project.id=041843f397054b8ab2fcb4c5d90067c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:25.445500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3c41-917f-4d63-b035-c348b3edfeab None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:25.446066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3c41-917f-4d63-b035-c348b3edfeab None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:25.446066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3c41-917f-4d63-b035-c348b3edfeab None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:25.447364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 564/1147] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:25.452499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:25.452982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:25.453072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:25.471046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:25.472229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:25.537402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 584/1148] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:25.803074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3c41-917f-4d63-b035-c348b3edfeab None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:25.901667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3c41-917f-4d63-b035-c348b3edfeab None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:25.934270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:25.934878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:25.935153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:25.935420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:25.945940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:25.950677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:25.951755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:25.952981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 565/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:25.957827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:26.052883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36347fc6-5b49-4cb5-80fd-4af30fa657ae None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:26.072996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:26.086604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:26.087201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:26.087476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:26.087752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:26.088405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:26.088705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:26.090090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:26.098030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 585/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:26.103760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:26.162748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:26.203444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba5886-1c24-4dbf-b5cc-514d562c87fa None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:26.236046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:26.236656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:26.236963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:26.237235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] PATH_INFO: `/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:26.238355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] RBAC: Authorizing `identity:get_user(user_id=00d5f8fb75b64306ac0eb5c6d75c5c95)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:26.239776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:26.241351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 566/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:26 2022] GET /identity/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:26.247068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:26.344066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a44701-e5a3-49d0-8f05-ffcb7640b22c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:26.376549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:26.377184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:26.377463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:26.377734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] PATH_INFO: `/v3/projects/041843f397054b8ab2fcb4c5d90067c3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:26.378836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] RBAC: Authorizing `identity:get_project(project_id=041843f397054b8ab2fcb4c5d90067c3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:26.380252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f5f14-05d1-4abc-ad2b-aa1840de65b4 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:26.381885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 586/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:26 2022] GET /identity/v3/projects/041843f397054b8ab2fcb4c5d90067c3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:26.387747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:26.487588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1ba0b-f1ed-476d-855a-800b928ab30a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:26.513214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:26.521518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:26.522158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:26.522431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:26.522699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] PATH_INFO: `/v3/projects/041843f397054b8ab2fcb4c5d90067c3/users/00d5f8fb75b64306ac0eb5c6d75c5c95/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:26.524568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] RBAC: Authorizing `identity:create_grant(project_id=041843f397054b8ab2fcb4c5d90067c3, user_id=00d5f8fb75b64306ac0eb5c6d75c5c95, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:26.526014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948ed39-8678-4e6f-952e-5aaf41b5ff93 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:26.539152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 567/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:32:26 2022] PUT /identity/v3/projects/041843f397054b8ab2fcb4c5d90067c3/users/00d5f8fb75b64306ac0eb5c6d75c5c95/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:32:28.417282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d3a4-6e36-4ce8-a525-8d7464ce3286 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:28.417848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d3a4-6e36-4ce8-a525-8d7464ce3286 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:28.417848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5d3a4-6e36-4ce8-a525-8d7464ce3286 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:28.419154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 587/1154] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:28.424699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:28.425125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:28.425276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:28.443565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:28.444743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:28.509500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 568/1155] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:28.778580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5d3a4-6e36-4ce8-a525-8d7464ce3286 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:28.831760 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:28.881766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5d3a4-6e36-4ce8-a525-8d7464ce3286 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:28.914552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:28.915166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:28.915443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:28.915713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:28.925992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:28.930728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:28.931826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:28.933013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 588/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:28.937963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:29.036125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3bcde-3884-4ddb-8b2e-0192090b71ce None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:29.052822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:29.070624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:29.071221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:29.071499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:29.071772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:29.072428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:29.072729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:29.074130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:29.082676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 569/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:29.088429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:29.185742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61142123-6590-45f0-b355-ac993cec7eb1 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:29.195735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:29.219286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:29.219895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:29.220171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:29.220439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] PATH_INFO: `/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:29.221568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] RBAC: Authorizing `identity:get_user(user_id=00d5f8fb75b64306ac0eb5c6d75c5c95)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:29.222991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:29.224743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 589/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:29 2022] GET /identity/v3/users/00d5f8fb75b64306ac0eb5c6d75c5c95 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:29.230530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:29.328129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cbf97-a4fb-432c-aa20-691f2e166c88 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:29.359692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:29.360277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:29.360549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:29.360842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:29.408106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:29.427176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:29.428677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:29.523584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 570/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:32:29.529736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:29.628154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef087891-2a5c-4ac1-a096-5e4608b245ea None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:29.661327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:29.661941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:29.662220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:29.662493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] PATH_INFO: `/v3/projects/041843f397054b8ab2fcb4c5d90067c3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:29.663597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] RBAC: Authorizing `identity:get_project(project_id=041843f397054b8ab2fcb4c5d90067c3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:29.665046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f343-69c6-4217-bdab-2b49454ed378 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:29.666651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 590/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:29 2022] GET /identity/v3/projects/041843f397054b8ab2fcb4c5d90067c3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:29.672692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:29.755234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:29.775257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150608e-14e4-4661-9403-2c2edfd1748f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:29.809111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:29.809708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:29.809983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:29.810249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:29.810960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=041843f397054b8ab2fcb4c5d90067c3, user.id=00d5f8fb75b64306ac0eb5c6d75c5c95) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:29.811260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:29.812684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56de32-b669-4662-881a-a6b9233b59c3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:29.818247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 571/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:29 2022] GET /identity/v3/role_assignments?user.id=00d5f8fb75b64306ac0eb5c6d75c5c95&scope.project.id=041843f397054b8ab2fcb4c5d90067c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:31.716102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade1f77-2d78-428b-896d-b742d6682cd6 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:31.716688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade1f77-2d78-428b-896d-b742d6682cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:31.716688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade1f77-2d78-428b-896d-b742d6682cd6 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:31.718145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 591/1162] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:31.723390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:31.723812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:31.723945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:31.741853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:31.743033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:31.809067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 572/1163] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:32.075209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade1f77-2d78-428b-896d-b742d6682cd6 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:32.122975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:32.176594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade1f77-2d78-428b-896d-b742d6682cd6 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:32.208927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:32.209519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:32.209794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:32.210063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:32.275123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:32.276549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:32.318864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:32.369894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 592/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:32.376478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:32.448559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:32.474152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229d3d-9b2b-4145-b804-52e07a706b34 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:32.508018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:32.508638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:32.508946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:32.509219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:32.516282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:32.517749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-e7fb1f53-7ac2-48f7-bc56-0e9228496b21 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:32.529109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:32.530742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:32.531785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 573/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:32:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:32.536504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:32.633870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86b095-b696-433d-8113-0626010cb0b9 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:32.666724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:32.667338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:32.667704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:32.667999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:32.668714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:32.669046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:32.670402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f36f7d-e903-4cd0-8db2-e2eb48efe07b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:32.677968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 593/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Wed Aug 31 10:32:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:34.549842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d143ad-b1a7-4e51-86f6-979fdf3b8e83 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:34.550399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d143ad-b1a7-4e51-86f6-979fdf3b8e83 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:34.550399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d143ad-b1a7-4e51-86f6-979fdf3b8e83 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:34.551705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 574/1167] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:34.556771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185faf-0aaf-4720-9bc4-f39cc83883c0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:34.557186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185faf-0aaf-4720-9bc4-f39cc83883c0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:34.557342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b185faf-0aaf-4720-9bc4-f39cc83883c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:34.576208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1b185faf-0aaf-4720-9bc4-f39cc83883c0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:34.578543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1b185faf-0aaf-4720-9bc4-f39cc83883c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:34.581313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:34.645312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 594/1168] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:34.913429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d143ad-b1a7-4e51-86f6-979fdf3b8e83 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:35.012108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d143ad-b1a7-4e51-86f6-979fdf3b8e83 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:35.044165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:35.044746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:35.045047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:35.045313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:35.046518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:35.047946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771415-550c-4a91-ada9-18c50cc62c02 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:35.051620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:35.064246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 575/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Wed Aug 31 10:32:34 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:36.980356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d2ca-791b-406b-9de9-15443c0ee4b4 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:36.980924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d2ca-791b-406b-9de9-15443c0ee4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:36.980924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848d2ca-791b-406b-9de9-15443c0ee4b4 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:36.982251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 595/1170] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:36.987542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:36.987938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:36.988100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:37.006610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:37.007802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:37.072991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 576/1171] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:37.338203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848d2ca-791b-406b-9de9-15443c0ee4b4 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:37.435369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848d2ca-791b-406b-9de9-15443c0ee4b4 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:37.467654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:37.468225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:37.468495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:37.468786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] PATH_INFO: `/v3/domains/444087db9844440dadba301531174c5c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:37.476688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:37.479375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=444087db9844440dadba301531174c5c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:37.481376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b785b-1d1a-44f5-bc34-17980df941c9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:37.483686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 596/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Wed Aug 31 10:32:37 2022] GET /identity/v3/domains/444087db9844440dadba301531174c5c => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:37.489632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:37.585801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7780-c2cc-408e-b45b-1397c111b2c2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:37.609498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:37.620155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:37.620779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:37.621059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:37.621330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:37.621969 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:37.623392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49383ac7-8c28-40b5-a097-6b2c8b5dd0cf None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:37.648832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 577/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:32:37 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:39.572433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549aaa-21ab-4af3-8716-902d44e410f9 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:39.573022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549aaa-21ab-4af3-8716-902d44e410f9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:39.573129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549aaa-21ab-4af3-8716-902d44e410f9 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:39.574436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 597/1174] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:39.580098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:39.580535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:39.580634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:39.598889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:39.600052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:39.664319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 578/1175] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:39.933801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549aaa-21ab-4af3-8716-902d44e410f9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:40.034335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549aaa-21ab-4af3-8716-902d44e410f9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:40.066434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:40.067046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:40.067322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:40.067591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] PATH_INFO: `/v3/domains/444087db9844440dadba301531174c5c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:40.068702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=444087db9844440dadba301531174c5c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:40.070139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c5c24-ac0a-4523-823d-f2657b03dca2 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:40.071711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 598/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Wed Aug 31 10:32:39 2022] GET /identity/v3/domains/444087db9844440dadba301531174c5c => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:40.077697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:40.174792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ac30-c4de-4819-bca7-80557a93566e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:40.182011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:40.209024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:40.209559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:40.209832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:40.210098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:40.210747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:40.212174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde8553-9d5f-4917-866b-5c88c5594522 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:40.235738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 579/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:32:40 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:32:42.176651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622e541-f11e-46d0-b88f-f8bdd7f3839f None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:42.177240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622e541-f11e-46d0-b88f-f8bdd7f3839f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:42.177240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622e541-f11e-46d0-b88f-f8bdd7f3839f None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:42.178549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 599/1178] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:42.183607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:42.183983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:42.184167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:42.204016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:42.205227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:42.270510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 580/1179] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:42.545505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622e541-f11e-46d0-b88f-f8bdd7f3839f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:42.610833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:42.644485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622e541-f11e-46d0-b88f-f8bdd7f3839f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:42.677413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:42.678032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:42.678307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:42.678574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:42.688923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:42.693646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:42.694758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:42.695662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 600/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:42.700719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:42.789400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:42.798890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da8ef5-022d-4ca3-80bd-5bcb892f8783 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:42.832944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:42.833539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:42.833814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:42.834082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:42.834737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:42.835035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:42.836403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:42.844281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 581/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:42.850131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:42.946097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd1390-9ca5-4f9c-ae55-bef52e341cd2 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:42.971695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:42.979516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:42.980138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:42.980407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:42.980675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] PATH_INFO: `/v3/users/2891fc0e9d0c438b816f06c4add1d4fc` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:42.993673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] RBAC: Authorizing `identity:get_user(user_id=2891fc0e9d0c438b816f06c4add1d4fc)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:42.995100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:42.996661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 601/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:42 2022] GET /identity/v3/users/2891fc0e9d0c438b816f06c4add1d4fc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:43.003218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:43.100166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bf97e-7d5e-43ad-bcfb-c61bca184f18 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:43.133281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:43.133863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:43.134136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:43.134402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:43.157590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:43.200172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:43.201726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:43.298843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 582/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:43.304864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:43.402386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910098-119b-46fd-87eb-42b710f71e08 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:43.435499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:43.436672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:43.436968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:43.437232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] PATH_INFO: `/v3/projects/b9fa275bab4e45d1968cfb27375eda85` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:43.438327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] RBAC: Authorizing `identity:get_project(project_id=b9fa275bab4e45d1968cfb27375eda85)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:43.439736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e1118-141f-4953-bd67-5eb134e6bc26 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:43.441360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 602/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:43 2022] GET /identity/v3/projects/b9fa275bab4e45d1968cfb27375eda85 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:43.447472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:43.501683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:43.545056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a8f7-f357-4527-8930-4d2574887e9d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:43.578288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:43.578874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:43.579150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:43.579421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:43.580132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=b9fa275bab4e45d1968cfb27375eda85, user.id=2891fc0e9d0c438b816f06c4add1d4fc) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:43.580437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:43.582026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455caef-18c2-403f-bf8d-f4fd2cd9b614 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:43.587201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 583/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:43 2022] GET /identity/v3/role_assignments?user.id=2891fc0e9d0c438b816f06c4add1d4fc&scope.project.id=b9fa275bab4e45d1968cfb27375eda85&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:45.496081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e930-e5ff-434f-ad13-fd36f03c1500 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:45.496636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e930-e5ff-434f-ad13-fd36f03c1500 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:45.496636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0e930-e5ff-434f-ad13-fd36f03c1500 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:45.497993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 603/1186] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:45.503910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:45.504294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:45.504456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:45.522759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:45.523937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:45.589756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 584/1187] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:45.865185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e930-e5ff-434f-ad13-fd36f03c1500 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:45.922539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:45.965566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0e930-e5ff-434f-ad13-fd36f03c1500 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:45.998904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:45.999896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:46.000177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:46.000450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:46.010317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:46.015417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:46.016548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:32:46.017822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 604/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:46.022856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:46.075629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:46.125163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdf80-4eba-47bd-b02e-481670be57e7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:46.159094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:46.159692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:46.159974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:46.160242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:46.160929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:46.161233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:46.162592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:46.170855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 585/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:46.176683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:46.273556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da618dcd-d0a6-4cbd-b907-44640e0c6d5c None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:46.287233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:46.306288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:46.306901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:46.307176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:46.307442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] PATH_INFO: `/v3/users/2891fc0e9d0c438b816f06c4add1d4fc` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:46.308531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] RBAC: Authorizing `identity:get_user(user_id=2891fc0e9d0c438b816f06c4add1d4fc)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:46.309981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:46.311555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 605/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:46 2022] GET /identity/v3/users/2891fc0e9d0c438b816f06c4add1d4fc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:46.317391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:46.416065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71955d30-2c73-4f04-b954-47e44d3517da None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:46.426041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:46.448716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:46.449354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:46.449628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:46.449894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] PATH_INFO: `/v3/projects/b9fa275bab4e45d1968cfb27375eda85` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:46.450979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] RBAC: Authorizing `identity:get_project(project_id=b9fa275bab4e45d1968cfb27375eda85)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:46.453055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d6f36-7edb-4a6b-8027-cc3ff1953493 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:46.454666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 586/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:46 2022] GET /identity/v3/projects/b9fa275bab4e45d1968cfb27375eda85 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:46.460827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:46.558871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a301e9-1517-4dcb-881b-b28cd9f91e9a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:46.591280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:46.591912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:46.592719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:46.593045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] PATH_INFO: `/v3/projects/b9fa275bab4e45d1968cfb27375eda85/users/2891fc0e9d0c438b816f06c4add1d4fc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:46.594896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] RBAC: Authorizing `identity:create_grant(project_id=b9fa275bab4e45d1968cfb27375eda85, user_id=2891fc0e9d0c438b816f06c4add1d4fc, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:46.596303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dfbfb-e394-4aa2-aa3a-9de7f3a02cfb None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:46.609165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 606/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:32:46 2022] PUT /identity/v3/projects/b9fa275bab4e45d1968cfb27375eda85/users/2891fc0e9d0c438b816f06c4add1d4fc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:32:48.516023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e45-a221-4036-bc86-9397457177d8 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:48.516573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e45-a221-4036-bc86-9397457177d8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:48.516573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85361e45-a221-4036-bc86-9397457177d8 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:48.517937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 587/1193] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:32:48.523404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:48.523774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:48.523947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:48.542279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:32:48.543446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:32:48.577118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:48.608242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 607/1194] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:32:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:32:48.881037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361e45-a221-4036-bc86-9397457177d8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:48.978732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85361e45-a221-4036-bc86-9397457177d8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.011291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.011918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.012201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.012479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.023702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:32:49.028447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:32:49.029735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:32:49.030952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 588/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:32:49.035587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:49.132090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b7fae-426b-4f1c-a1e3-1ac8492cbe49 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.164556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.165192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.165466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.165737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.166391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:49.166690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:49.168047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:49.176688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 608/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:49.182580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:49.222732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:49.280814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ab28-1bac-4a84-bf1a-a0c7983acd68 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.312861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117265-573b-493c-b114-316661167d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.313466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117265-573b-493c-b114-316661167d4f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.313741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117265-573b-493c-b114-316661167d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.314006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117265-573b-493c-b114-316661167d4f None admin] PATH_INFO: `/v3/users/2891fc0e9d0c438b816f06c4add1d4fc` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.315093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117265-573b-493c-b114-316661167d4f None admin] RBAC: Authorizing `identity:get_user(user_id=2891fc0e9d0c438b816f06c4add1d4fc)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:49.316515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117265-573b-493c-b114-316661167d4f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:49.318083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 589/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Wed Aug 31 10:32:49 2022] GET /identity/v3/users/2891fc0e9d0c438b816f06c4add1d4fc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:49.324273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:49.359084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:49.423357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765c6ad-c783-408c-a255-3f31e95eba3a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.455518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.456106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.456386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.456653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.520906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:49.522334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:49.554053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:49.618095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 609/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:32:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:32:49.624202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117265-573b-493c-b114-316661167d4f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:49.722436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117265-573b-493c-b114-316661167d4f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.729032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:49.755938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.756552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.756864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.757140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] PATH_INFO: `/v3/projects/b9fa275bab4e45d1968cfb27375eda85` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.758235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] RBAC: Authorizing `identity:get_project(project_id=b9fa275bab4e45d1968cfb27375eda85)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:49.759691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb8cd6-e6f1-439f-8b9e-8edc59aadc57 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:49.761334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 590/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Wed Aug 31 10:32:49 2022] GET /identity/v3/projects/b9fa275bab4e45d1968cfb27375eda85 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:49.767343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:32:49.864398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183a126-cb97-48e6-9a25-c998b00b2695 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:32:49.897357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:32:49.897944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:32:49.898219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:32:49.898488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:32:49.899198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=b9fa275bab4e45d1968cfb27375eda85, user.id=2891fc0e9d0c438b816f06c4add1d4fc) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:32:49.899503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:32:49.900938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a5048-14bf-4810-a607-3040f12536c9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:32:49.902656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:49.908141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 610/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:32:49 2022] GET /identity/v3/role_assignments?user.id=2891fc0e9d0c438b816f06c4add1d4fc&scope.project.id=b9fa275bab4e45d1968cfb27375eda85&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:32:59.751890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=13 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:32:59.906700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:45.384300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd31f7c-7ffe-46c8-aff3-6164b7d49cde None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:45.384905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd31f7c-7ffe-46c8-aff3-6164b7d49cde None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:45.384905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd31f7c-7ffe-46c8-aff3-6164b7d49cde None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:45.386635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 591/1201] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:33:45.392798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:45.396296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:45.396296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:45.412347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:33:45.413885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:33:45.520840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 611/1202] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:33:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:33:45.794375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd31f7c-7ffe-46c8-aff3-6164b7d49cde None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:45.928720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd31f7c-7ffe-46c8-aff3-6164b7d49cde None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:45.972742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:45.973456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:45.973814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:45.974019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:45.986581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:45.988178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:46.009545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:46.010699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:46.011693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:46.011693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:46.011693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:46.011693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 592/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:46.020834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:46.153884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb7933-acaa-4c15-af4f-439f632b52c9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:46.189480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:46.200124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:46.200930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:46.201244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:46.201558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:46.202288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:46.202625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:46.204201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839e2e6-1519-4f9e-b395-8d3aa784148a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:46.223034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 612/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:46.226452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:46.305449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:46.364113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a11c50-ad84-4780-9bc9-182ad4788ec1 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:46.408977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:46.409634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:46.409781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:46.410059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:46.410769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:46.412261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22accc-ecd4-4bc1-8375-4a2c66016b4f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:46.438210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 593/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Wed Aug 31 10:33:46 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:33:48.699727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd059d-9eb6-4077-8f6c-cc98fb8c8e04 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:48.700312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd059d-9eb6-4077-8f6c-cc98fb8c8e04 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:48.700312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd059d-9eb6-4077-8f6c-cc98fb8c8e04 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:48.702093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 613/1206] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:33:48.708041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:48.708483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:48.708582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:48.729916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:33:48.731179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:33:48.814405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 594/1207] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:33:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:33:49.081944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd059d-9eb6-4077-8f6c-cc98fb8c8e04 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:49.206942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd059d-9eb6-4077-8f6c-cc98fb8c8e04 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:49.251963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:49.252602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:49.252973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:49.253211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:49.269628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:33:49.275235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:49.276284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:49.281959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 614/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:49.284369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:49.332932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:49.410794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cd004-c850-4cd0-8dbb-0fe4350004ef None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:49.461532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:49.462208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:49.462485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:49.462804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:49.463590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:49.463894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:49.465568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:49.476125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 595/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:49.486314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:49.558712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:49.637287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d99b1f-4016-4ac1-8277-44205f0c4d7b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:49.678353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:49.679052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:49.679395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:49.679662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:49.692949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:49.694436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:49.712112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:49.714009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:49.715034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:49.715034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:49.715034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:49.715034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 615/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:49.719899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:49.837361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:49.840163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665b8c6-91cf-405a-88fb-bce830d4920e None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:49.879029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:49.879665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:49.879935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:49.880206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:49.880890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:49.881220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:49.882685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:49.900722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 596/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:33:49.901920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:50.023167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c604a2f-13cf-48e8-b06c-2c9523af6eee None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:50.027177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:50.064448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:50.065230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:50.065524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:50.065777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:50.074859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:50.077130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:33:50.090858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:50.092734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:50.094323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 616/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:33:50.098681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:50.220212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52997-8d49-429e-9c5a-d85b87d28647 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:50.271949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:50.272553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:50.272863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:50.273232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:50.274012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:50.274318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:50.275814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:50.298478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 597/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:33:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:50.304191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:50.432730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b7a33-3879-46bd-8cb6-5801d1fffdd0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:50.474973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:50.475560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:50.475863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:50.476151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:50.510206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:50.553471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:50.554922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:50.676063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 617/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:33:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:33:50.681894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:50.705422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:50.812501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d3c8-ee68-4d5e-8eee-a9d17d71a6ad None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:50.855843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:50.856572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:50.857030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:50.857413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:50.870557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:50.872674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:50.890409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:50.891448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:50.892639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:50.892639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:50.892639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:50.892639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 598/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:50.897628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:50.973857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:51.017477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0d7c-e0d0-4d88-a1ea-dc7c7fda4188 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:51.055064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:51.055975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:51.056404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:51.056843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:51.057654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:51.058127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:51.059696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:51.071577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 618/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:51.077388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:51.160917 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:51.196975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e3cf8-0c9c-4b23-814b-8d9fd772ab4b None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:51.234017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:51.234721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:51.235001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:51.235272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:51.242922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:51.244449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:33:51.258191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:51.259338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:51.261972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 599/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:33:51.265991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:51.383504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88df2d-1134-43f6-978f-cbb168835b4e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:51.416592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:51.431735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:51.432348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:51.432624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:51.432959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:51.433646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:51.433954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:51.435437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de28d-5aa1-4e69-83dc-b9826f82da7b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:51.449475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 619/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:51.456139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:51.578347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208afdc-ade0-4475-b513-2204ef357ab0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:51.612457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:51.621263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:51.621990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:51.622424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:51.623288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:51.624020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=72b84b6ae6034eefabc8156213f20797) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:51.624330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:51.626136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53e44b-efa2-4a90-982b-6516b8f594c8 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:51.633974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 600/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:33:51 2022] GET /identity/v3/role_assignments?user.id=72b84b6ae6034eefabc8156213f20797&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:53.670157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2b82-4612-49d0-9d87-6053690fd7d5 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:53.670758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2b82-4612-49d0-9d87-6053690fd7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:53.670869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2b82-4612-49d0-9d87-6053690fd7d5 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:53.672436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 620/1220] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:33:53.678877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:53.679517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:53.679517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:53.698963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:33:53.700145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:33:53.772078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 601/1221] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:33:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:33:54.041673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2b82-4612-49d0-9d87-6053690fd7d5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:54.151060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2b82-4612-49d0-9d87-6053690fd7d5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:54.187009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:54.187635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:54.187910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:54.188180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:54.198045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:33:54.202980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:54.204108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:54.205121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 621/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:33:54.210257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:54.335891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0d63a-20f5-4e0d-972e-20561cffc91a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:54.362298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:54.376932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:54.377547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:54.377823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:54.378092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:54.378902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:54.379301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:54.380826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:54.389254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 602/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:54.395263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:54.443911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:54.506614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb40ac-a35c-4ecb-8faa-f925812ae4a6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:54.542556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:54.543191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:54.543467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:54.543838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:54.554867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:54.556341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:54.570761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:54.577402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:54.578546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:54.578546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:54.578546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:54.578546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 622/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:54.578904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:54.699166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13f2a7-9d14-4b7d-a4b6-8126ffff28e0 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:54.741397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:54.742305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:54.742590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:54.742976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:54.743743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:54.744045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:54.745433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:54.758635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 603/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:54.765098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:54.873855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:54.880804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a2e9c-0dc2-4580-927f-7062e0d2432f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:54.916566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:54.917225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:54.917502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:54.917766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:54.926235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:54.927822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:33:54.940989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:54.942359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:54.943509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 623/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:33:54.948333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.001906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:55.064101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b342-9709-4026-a3ee-aea3596dd4a7 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:55.108455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:55.109177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:55.109514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:55.109789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:55.110721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:55.111074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:55.112687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:55.132041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 604/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:33:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:33:55.138224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.251170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc550e0d-d0e3-450d-aefd-1808d36b46db None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:55.292448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:55.292809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:55.293123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:55.293359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:55.304358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:55.305819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:55.320174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:55.321434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:55.322366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:55.322366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:55.322366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:55.327104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 624/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:55.328137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.451999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33099d7-3676-4b69-8811-85225c5bde21 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:55.455163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:55.490969 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:55.491573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:55.491849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:55.492117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:55.492749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:55.493071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:55.494437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:55.508443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 605/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:55.516365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.528650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:55.628197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c60ec-4982-471c-b913-d7910cd82610 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:55.665367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:55.666001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:55.666281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:55.666556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:55.673476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:55.674926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:33:55.687239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:55.688294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:33:55.689250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 625/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:55.694325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.815666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6df8cc-9281-46da-af48-7e9ed22ffc4a None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:55.855869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:55.856471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:55.857442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:55.857787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:55.858486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:55.858788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:55.860351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da61bf2-a96b-4674-a45b-92376b51f055 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:55.875453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 606/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:55.882690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:55.958121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:55.999309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993971a-1a87-456d-a4b0-1b023965dda1 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:56.039987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:56.040773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:56.041116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:56.041395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/72b84b6ae6034eefabc8156213f20797/roles/30da1255652b4c2db0a7295e7c051d08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:56.057693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=72b84b6ae6034eefabc8156213f20797, role_id=30da1255652b4c2db0a7295e7c051d08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:56.059458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c007380-4271-4be5-802c-d41c5a18d21f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:56.072428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 626/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:33:55 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/72b84b6ae6034eefabc8156213f20797/roles/30da1255652b4c2db0a7295e7c051d08 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:33:58.056127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20e8-1ddf-4594-b90d-b2d6db355f6e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:58.056623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20e8-1ddf-4594-b90d-b2d6db355f6e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:58.056623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a20e8-1ddf-4594-b90d-b2d6db355f6e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:58.058114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 607/1233] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:33:58.063144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:58.063537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:58.063701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:58.083795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:33:58.085016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:33:58.163848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 627/1234] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:33:58.478060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a20e8-1ddf-4594-b90d-b2d6db355f6e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:58.506747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:58.587181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a20e8-1ddf-4594-b90d-b2d6db355f6e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:58.625432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:58.626059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:58.626335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:58.626838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:58.637903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:33:58.643153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:58.645037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:58.646098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 608/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Wed Aug 31 10:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:58.650511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:58.702440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:58.760689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba04e73-3fe4-4a62-9896-63f78e7a7b77 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:58.798009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:58.798619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:58.798894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:58.799162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:58.799829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:58.800138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:58.801536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:58.810577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 628/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Wed Aug 31 10:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:58.817157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:58.912300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:58.931368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb463-93f4-4b5f-9f84-4329f57536b2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:58.973752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:58.974762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:58.975098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:58.975431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:58.987250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:58.988748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:33:59.006683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:59.007903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:33:59.008982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:33:59.008982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:33:59.008982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:59.008982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 609/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:33:59.013708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:59.131659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af0d03-2276-4ae3-8926-84ce61417c2d None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:59.144602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:59.172905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:59.173509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:59.173785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:59.174044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:59.174721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:59.175047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:59.176375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:59.189296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 629/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:59.195325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:59.310502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710438-51a1-4370-acd4-0c7ca7beabe2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:59.346524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:59.347350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:59.347670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:59.348151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:59.353810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:59.360905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:59.362868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:33:59.375371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:33:59.376564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:33:59.377867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 610/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:33:59.382380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:59.498584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9666329-6dbb-42f5-81bf-c8f46af59034 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:59.534931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:59.535531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:59.535809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:59.536127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:59.536895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:33:59.537234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:59.538642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:59.557918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 630/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:33:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:33:59.564274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:59.688290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f6ed1-0b22-43d6-baf3-761e33a5326d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:33:59.729614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:33:59.730221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:33:59.730543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:33:59.730853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:33:59.807878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:33:59.816036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:33:59.818909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:33:59.928274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 611/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:33:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:33:59.935243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:33:59.967121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:00.052287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e798de9-9688-4a82-87a4-eed4cf1e4dad None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:00.090602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:00.091393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:00.091645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:00.091917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:00.102897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:00.104340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:00.120654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:00.126266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:00.127390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:00.127390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:00.127390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:00.127390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 631/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:34:00.128207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:00.238026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:00.246768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2156d-4079-4ed9-bff2-0e5955a4d5f4 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:00.287405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:00.288278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:00.288716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:00.289315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:00.290502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:00.291002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:00.293390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:00.308803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 612/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:00.315058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:00.399519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:00.424037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfaea1-6ed9-4e9e-b0bc-3810ef561f8f None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:00.463332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:00.463975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:00.464259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:00.464588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:00.472053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:00.473528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:34:00.486024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:00.487550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:00.488686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 632/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:00.493351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:00.612430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1ed3c-f8ea-487d-976c-e487107e4cc2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:00.652315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:00.652926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:00.653294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:00.654120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:00.655044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:00.655502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:00.657187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b51b1-96d2-4703-a86a-ca1ceedc170f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:00.671634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 613/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:34:00.677937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:00.806116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb5a3-29df-41eb-be10-f8b521618354 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:00.846993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:00.847617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:00.847891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:00.848157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:00.848951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] RBAC: Adding query filter params (role.id=30da1255652b4c2db0a7295e7c051d08, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=72b84b6ae6034eefabc8156213f20797) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:00.849255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:00.850737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7bb62-2249-4e2c-b02b-95e09f057257 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:00.857635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 633/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:34:00 2022] GET /identity/v3/role_assignments?user.id=72b84b6ae6034eefabc8156213f20797&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=30da1255652b4c2db0a7295e7c051d08 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:02.983449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85740e7-1d6b-4b46-99c6-6965c8fe226e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:02.984087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85740e7-1d6b-4b46-99c6-6965c8fe226e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:02.984087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85740e7-1d6b-4b46-99c6-6965c8fe226e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:02.985461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 614/1247] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:34:02.990960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:02.991447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:02.991548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:02.998774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:03.014249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:03.015555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:03.092030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 634/1248] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:03.387545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85740e7-1d6b-4b46-99c6-6965c8fe226e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:03.407200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:03.505374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85740e7-1d6b-4b46-99c6-6965c8fe226e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:03.545414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:03.546161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:03.546435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:03.546703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:03.558278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:34:03.564078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:03.565184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:03.566104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 615/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:03.571623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:03.678405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6700d7d-6e9d-44ca-9c12-e6317f3bfaa5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:03.711377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:03.717582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:03.718191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:03.718471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:03.718738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:03.719397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:03.719699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:03.721099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:03.729896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 635/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:34:03.736207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:03.821503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:03.849326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32cee6-24e4-4d48-aba5-e2280419df35 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:03.886457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:03.887099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:03.887371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:03.887779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:03.898302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:03.899754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:03.915210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:03.916466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:03.917504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:03.917504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:03.917504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:03.917504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 616/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:34:03.923325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:04.039671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864429f-d50b-45fc-8ac9-51f73f6b3534 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:04.077369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:04.077980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:04.078259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:04.078534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:04.079180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:04.079479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:04.080867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:04.094005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 636/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:04.100453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:04.205942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937c9a9-8154-4035-a424-6268452a696d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:04.236110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:04.248848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:04.249837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:04.250408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:04.250926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:04.261624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:04.265071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:34:04.280482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:04.281843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:04.282963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:04.285527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 617/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:04.292038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:04.358978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:04.411338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a039fa-bbb2-4015-9439-09064c07bf6b None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:04.449984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:04.450737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:04.451010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:04.451324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:04.451998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:04.452330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:04.454412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:04.483416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 637/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:34:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:04.490104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:04.597157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fea5a-b900-4562-8792-14425b5338ca None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:04.635701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:04.636341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:04.636619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:04.636918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:04.695076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:04.707615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:04.709104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:04.816032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 618/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:34:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:34:04.822641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:04.936617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5ad78-a9d1-4cc3-be11-b1e078e38802 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:04.952181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:04.973647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:04.974274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:04.974541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:04.974808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:04.985888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:04.987293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:05.002782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:05.004006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:05.005009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:05.005009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:05.005009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:05.005009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 638/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:05.009700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:05.101182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:05.114731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f04c15-ccd2-4a82-a1b9-5340b3442d2f None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:05.151649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:05.152213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:05.152487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:05.152783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:05.154045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:05.154344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:05.155715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:05.167754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 619/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:05.174200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:05.294264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae08e4-d7ae-4468-91ed-a6a668918786 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:05.330047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:05.330674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:05.330948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:05.331214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:05.337947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:05.339500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:34:05.352703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:05.353844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:05.354779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 639/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:34:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:34:05.360967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:05.471642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac6aff-0a38-4e2f-8a8f-54f1f5372c8c None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:05.507673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:05.508287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:05.508554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:05.508848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:05.509537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:05.509836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:05.511256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2402-c253-4e04-9c51-e75f6c6afcf9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:05.523983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 620/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:05.530806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:05.561370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:05.642559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dc737-ab3b-4543-8f2f-3e6549d040d7 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:05.681881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:05.682511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:05.682790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:05.683059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:05.683854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=72b84b6ae6034eefabc8156213f20797) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:05.684166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:05.685667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b00c89-1dd8-46cd-b53a-0ac94bf41399 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:05.704792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 640/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:34:05 2022] GET /identity/v3/role_assignments?user.id=72b84b6ae6034eefabc8156213f20797&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:07.589237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4644e-8439-4587-9795-dcaa3e75e8c6 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:07.589791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4644e-8439-4587-9795-dcaa3e75e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:07.589791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4644e-8439-4587-9795-dcaa3e75e8c6 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:07.591139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 621/1261] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:07.596094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:07.596480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:07.596637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:07.616020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:07.617222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:07.682545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 641/1262] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:07.949240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4644e-8439-4587-9795-dcaa3e75e8c6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:07.960535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.049737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4644e-8439-4587-9795-dcaa3e75e8c6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.082145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.082750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.083023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.083289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.093768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:34:08.098542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:08.099650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:08.100987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 622/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:08.105513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:08.123297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.205298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583fbb1-c667-4f9f-a805-ff139a38492d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.238757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.239421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.239722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.240041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.240698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:08.241030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:08.242592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:08.252318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 642/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:08.258694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:08.334293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.366412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd85a3-d90b-4676-8bba-fa979ad94c87 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.399989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.400599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.400909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.401182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.410832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:08.412371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:08.426601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:08.427725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:08.428850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:08.428850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:08.428850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:08.428850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 623/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:08.433547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:08.511314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.532935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86598aa-58cd-498a-b9ab-8d0de0b6435a None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.568067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.568664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.568966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.569237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.569867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:08.570165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:08.571516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:08.583393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 643/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:08.589186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:08.687948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784276-2f33-4bc7-852e-fee631b3d6f3 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.706681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.720960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.721576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.721850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.722115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.730185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:08.732117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:34:08.742956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:08.744056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:08.745078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 624/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:08.750487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:08.852074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b827c-91cd-4a9f-82f3-842cc0a3fc4e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:08.888337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:08.888952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:08.889229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:08.889499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:08.890216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:08.890516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:08.892190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:08.900591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:08.909904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 644/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:08.915588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:09.011736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929c303-84f2-4f71-9dcf-4e168d529975 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:09.044393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:09.045024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:09.045298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:09.045564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:09.055677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:09.057077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:09.071211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:09.072326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:09.073464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:09.073464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:09.073464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:09.073464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 625/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:09.078946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:09.174732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f789d73-d32a-483b-9a5c-280f93707b20 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:09.208018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:09.208610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:09.208915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:09.209188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:09.209820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:09.210118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:09.211474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:09.222565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 645/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:09.228326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:09.267330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:09.337278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771b889-09ab-441e-8614-6ec54029e6b2 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:09.369604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:09.370215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:09.370486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:09.370750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:09.377790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:09.379249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:34:09.390270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:09.391326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:09.392629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 626/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:09.397516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:09.454851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:09.495592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecbe44-5aed-4956-8e92-500afbcbe3cd None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:09.527629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:09.528241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:09.528513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:09.528798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:09.529471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:09.529769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:09.531173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aba4d-8828-4e1a-af17-10f1f8fdf5b9 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:09.542512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 646/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:09.549524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:09.639671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:09.649037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34acf7-7845-4bbb-b21f-3c499074c564 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:09.681919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:09.682553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:09.682827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:09.683095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] PATH_INFO: `/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/72b84b6ae6034eefabc8156213f20797/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:09.685511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=981900e50ea443c58e0ddce02bf8b5c3, user_id=72b84b6ae6034eefabc8156213f20797, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:09.686938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59ea70-019d-4530-8058-33bb95d425a0 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:09.698983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 627/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Wed Aug 31 10:34:09 2022] PUT /identity/v3/projects/981900e50ea443c58e0ddce02bf8b5c3/users/72b84b6ae6034eefabc8156213f20797/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:34:11.583213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1ec0-9ee2-40a6-9004-9541ba623b03 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:11.583782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1ec0-9ee2-40a6-9004-9541ba623b03 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:11.583782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1ec0-9ee2-40a6-9004-9541ba623b03 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:11.585117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 647/1274] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:11.590105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:11.591230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:11.591407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:11.609302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:11.610488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:11.677126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 628/1275] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:11.942828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1ec0-9ee2-40a6-9004-9541ba623b03 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.041574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1ec0-9ee2-40a6-9004-9541ba623b03 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.058593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:12.075040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.075644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.075921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.076191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.085931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:34:12.091459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:12.092603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:12.093862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 648/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Wed Aug 31 10:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:12.098370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.177117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:12.196218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062302fa-58ba-4991-b661-4818ba51b62a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.229912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.230499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.230799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.231076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.231905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:12.232220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:12.233832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:12.243507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 629/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:12.251079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.365440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ca96-5982-475e-b14f-8333464da3e6 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.398420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.399040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.399315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.399585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.409286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:12.410728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:12.425280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:12.426387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:12.427549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:12.427549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:12.427549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:12.428909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 649/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:12.432271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.529941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fd978-2888-4988-9020-49bf61ffdae6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.562468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.563057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.563331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.563597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.564226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:12.564528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:12.565926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:12.577959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 630/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:12.583850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.613959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:12.680557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1bf17-cc5a-4c66-b248-9e7c0b886e1e None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.711829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.712430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.712702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.712994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.720607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:12.722052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:34:12.733017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:12.734138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:12.735302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 650/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:12.739976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.743817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:12.842799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88982d-c305-4e28-b603-0c1b884be18d None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:12.876304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:12.876921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:12.877197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:12.877465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:12.878180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:12.878478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:12.879898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:12.899582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 631/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:12.905464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:12.992752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:13.003200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045143be-c858-4ce7-95ea-62fa207ea049 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.035390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.035974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.036244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.036509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.099878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.101323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.186108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:13.196488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 651/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Wed Aug 31 10:34:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:34:13.202314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:13.266182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:13.304166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8000f5d-ca74-4f74-b7e8-fb2d534008e9 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.337621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.338285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.338563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.338830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.349021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.350510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:34:13.364693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:13.365864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:34:13.366963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:34:13.366963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:34:13.366963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:13.366963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 632/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:13.371552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:13.467316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e6c9-39bd-4f02-8d5f-691ab19d98e0 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.499965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.500551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.500857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.501129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.501758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:13.502055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.503406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.515052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 652/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Wed Aug 31 10:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:13.520941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:13.623511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d7574-90a1-4344-b06d-a32c8205ae00 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.636857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:13.658542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.659161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.659438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.659709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.666115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.667553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:34:13.679486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:13.680550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: ERROR keystone.server.flask.application Aug 31 10:34:13.681674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 633/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Wed Aug 31 10:34:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:13.687243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:13.735487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:13.784923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d34872-6fc6-4cdc-8bbb-79b68d734345 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.818589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.819184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.819461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.819732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.820418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:13.820724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.822163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a694ce-83c9-4f94-9c8f-03bc7cfc5176 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.834446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 653/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Wed Aug 31 10:34:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:13.840522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:13.938636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f020fd8-9464-4109-8ec0-1149831ceee5 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:13.970688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:13.971280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:13.971558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:13.971829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:13.972546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] RBAC: Adding query filter params (role.id=8f7b507c61c145d1bc046fb6b4fb9e0e, scope.project.id=981900e50ea443c58e0ddce02bf8b5c3, user.id=72b84b6ae6034eefabc8156213f20797) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:13.972890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:13.974322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489e6d3-e5b5-4902-938d-08a1739432ab None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:13.979925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 634/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Wed Aug 31 10:34:13 2022] GET /identity/v3/role_assignments?user.id=72b84b6ae6034eefabc8156213f20797&scope.project.id=981900e50ea443c58e0ddce02bf8b5c3&role.id=8f7b507c61c145d1bc046fb6b4fb9e0e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:15.887286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd582b-d24c-4d7b-9d8e-173dac407fc8 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:15.887775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd582b-d24c-4d7b-9d8e-173dac407fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:15.887887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd582b-d24c-4d7b-9d8e-173dac407fc8 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:15.889185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 654/1288] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:15.894454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:15.894886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:15.895008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:15.913536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:15.914725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:15.944083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:15.981877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 635/1289] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:16.251632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd582b-d24c-4d7b-9d8e-173dac407fc8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:16.360965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd582b-d24c-4d7b-9d8e-173dac407fc8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:16.371096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:16.394490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:16.395104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:16.395378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:16.395645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] PATH_INFO: `/v3/services/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:16.396217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:16.397598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:16.406849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:16.409005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:16.410095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 655/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:34:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:16.413938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:16.510194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb8f5b-bf2b-418f-b66c-63f3332711e9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:16.543865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:16.544457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:16.544732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:16.545030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:16.545647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:16.545945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:16.547310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de579-432d-4851-9582-ffe1046ea2aa None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:16.551957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 636/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 31 10:34:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:16.557762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:16.656070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7d380-c98b-448b-b121-c8fefaf156ed None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:16.688325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:16.688939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:16.689217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:16.689484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] PATH_INFO: `/v3/services` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:16.690097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:16.690396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:16.691758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a8f9-86f7-4036-b8a2-d177a2b50e05 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:16.696058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 656/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 31 10:34:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:34:18.575088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8a4d-789e-431b-a29c-27536a143d31 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:18.575623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8a4d-789e-431b-a29c-27536a143d31 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:18.575623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be8a4d-789e-431b-a29c-27536a143d31 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:18.577144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 637/1293] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:18.582929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae2b-b256-4346-a3f7-3a042bcbea12 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:18.583368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae2b-b256-4346-a3f7-3a042bcbea12 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:18.583524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae2b-b256-4346-a3f7-3a042bcbea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:18.604311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a1e8ae2b-b256-4346-a3f7-3a042bcbea12 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:18.606171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a1e8ae2b-b256-4346-a3f7-3a042bcbea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:18.642303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:18.679770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 657/1294] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:18.975659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8a4d-789e-431b-a29c-27536a143d31 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:19.011239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:19.084647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be8a4d-789e-431b-a29c-27536a143d31 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:19.128138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:19.128747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:19.129056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:19.129329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:19.130130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:19.131707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254afd-e910-4111-b499-6eff91e79320 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:19.148735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 638/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Wed Aug 31 10:34:18 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:34:21.130810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2d1-c662-40e4-804c-fb852443c28b None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:21.131331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2d1-c662-40e4-804c-fb852443c28b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:21.131331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904da2d1-c662-40e4-804c-fb852443c28b None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:21.132668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 658/1296] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:21.137952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:21.138386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:21.138481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:21.156978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:21.158183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:21.227516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 639/1297] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:21.528619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da2d1-c662-40e4-804c-fb852443c28b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:21.626719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904da2d1-c662-40e4-804c-fb852443c28b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:21.661375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:21.661989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:21.662263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:21.662536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:21.663104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:21.664447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:21.673118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:21.674294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:21.675168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 659/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:34:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:21.680208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:21.698472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:21.788093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96be2-14f6-4473-a363-269a6386705f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:21.832328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:21.832956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:21.833238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:21.833512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:21.834143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:21.834447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:21.836101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:21.842443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 640/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 31 10:34:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:21.848370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:21.883195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:21.994890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84545e6-691b-439e-89f9-6ad81e7c3f95 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:22.027057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:22.028220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:22.028493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:22.028788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:22.029464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] RBAC: Adding query filter params (interface=public, service_id=08c05c89f9434f5c9585a7b6d315fd85, region_id=RegionOne) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:22.029766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:22.031111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f93c9f-8cd1-4c6d-9be1-402f235a743c None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:22.035918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 660/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Wed Aug 31 10:34:21 2022] GET /identity/v3/endpoints?service_id=08c05c89f9434f5c9585a7b6d315fd85&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:22.041656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:22.122149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:22.140434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c56f6-11ea-4709-b574-5b6ae318f3e6 None admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:22.173697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:22.174288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:22.174586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:22.174828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:22.175422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:22.176802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8945c-5f0c-4287-bf8a-13dff5eafe43 None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:22.183341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 641/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Wed Aug 31 10:34:22 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:34:24.086852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc658aa-019e-44c0-9a80-8d7aa386a194 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:24.087354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc658aa-019e-44c0-9a80-8d7aa386a194 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:24.087354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc658aa-019e-44c0-9a80-8d7aa386a194 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:24.088827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 661/1302] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:34:24.094592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:24.095030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:24.095123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:24.113781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:34:24.114979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:34:24.183356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 642/1303] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:34:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:34:24.475401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc658aa-019e-44c0-9a80-8d7aa386a194 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:24.569114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:24.575937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc658aa-019e-44c0-9a80-8d7aa386a194 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:24.608806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:24.609424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:24.609699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:24.609965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:24.610536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:24.611882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:34:24.620462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:34:24.622431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application with Lock( Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: ERROR keystone.server.flask.application Aug 31 10:34:24.623668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 662/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Wed Aug 31 10:34:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:34:24.628424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:24.705169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:24.729608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605dea8-ec0f-427b-8d6f-3f45780bfae8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:24.762720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:24.763311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:24.763586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:24.763855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] PATH_INFO: `/v3/services` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:24.764558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:34:24.764882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:24.766245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf636f3d-24eb-4e8f-abe2-01017dfaa0fb None admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:24.771423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 643/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Wed Aug 31 10:34:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:34:24.777805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:34:24.877053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c57ed-5bdd-46a6-b5d2-8f8cffdece04 None admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:34:24.911195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:34:24.911792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:34:24.912070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:34:24.912338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:34:24.913025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:34:24.914383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09238-248a-4e34-9395-e0de52b5c029 None admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:34:24.935858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 663/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:34:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:34:34.768557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=30 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:34:34.931073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:29.380894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb26de-3feb-43ce-87c9-36f885b6b50d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:29.381466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb26de-3feb-43ce-87c9-36f885b6b50d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:29.381466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb26de-3feb-43ce-87c9-36f885b6b50d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:29.388622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbd16-fc36-42c5-9a15-a4771f6f26c3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:29.389128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbd16-fc36-42c5-9a15-a4771f6f26c3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:29.389217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cbd16-fc36-42c5-9a15-a4771f6f26c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:29.394207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 644/1307] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:29.573049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-282cbd16-fc36-42c5-9a15-a4771f6f26c3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:29.576125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-282cbd16-fc36-42c5-9a15-a4771f6f26c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:29.748842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 664/1308] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:35:30.044995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:30.045272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:30.045730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:30.047445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 645/1309] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 31 10:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:30.054503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1bfd-f3f2-42d4-9274-6544d238a10e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:30.054863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1bfd-f3f2-42d4-9274-6544d238a10e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:30.055217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1bfd-f3f2-42d4-9274-6544d238a10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:30.144086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8b0d1bfd-f3f2-42d4-9274-6544d238a10e None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:30.145320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8b0d1bfd-f3f2-42d4-9274-6544d238a10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:30.169383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:30.231707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 665/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 31 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:30.240710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:30.242587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:30.362809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cbfbe-2b00-4bbc-998b-04949aa86848 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:30.442711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:30.443355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:30.443643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:30.443757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:30.445502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:30.506478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:30.567504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:30.568899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e552a-716b-4748-9f66-619b0df1b9b0 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:30.589444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 646/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:32.809678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:32.810217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:32.810217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:32.811806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 666/1312] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:32.817478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474cd2-28c1-4bda-85d8-efb858c86331 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:32.817959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474cd2-28c1-4bda-85d8-efb858c86331 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:32.818038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2474cd2-28c1-4bda-85d8-efb858c86331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:32.908017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b2474cd2-28c1-4bda-85d8-efb858c86331 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:32.909639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b2474cd2-28c1-4bda-85d8-efb858c86331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:33.020009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 647/1313] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:33.306652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:33.308854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:33.418983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e13f3-dbe1-4f24-9dd5-ef852eb7a465 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:33.494541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:33.498014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:33.498791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:33.499118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:33.499517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:33.501342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:33.618518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:33.620570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9087020-21e3-4dc3-a7b0-80c902ec6f75 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:33.639187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 667/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:35.861368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:35.861923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:35.861923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:35.863253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 648/1315] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:35.868466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f7fd-6f5b-4369-8b4d-ede6f5bf4b60 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:35.868935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f7fd-6f5b-4369-8b4d-ede6f5bf4b60 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:35.869029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f7fd-6f5b-4369-8b4d-ede6f5bf4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:35.952683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b3c6f7fd-6f5b-4369-8b4d-ede6f5bf4b60 None None] MFA Rules not processed for user `7054692c5f5d4267963f967598c9045d`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:35.954023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b3c6f7fd-6f5b-4369-8b4d-ede6f5bf4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:36.004201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:36.048380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 668/1316] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:36.375960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:36.377583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:36.387252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:36.481727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a3568-1aa7-4323-9dcb-5fe68b59a0cb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:36.554208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:36.554807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:36.555085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:36.555354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:36.556975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:36.618743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:36.666029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:36.668153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372c3f6-858d-4cc6-8f9c-13d8ee0203c3 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:36.687441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 649/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:39.149052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:39.149618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:39.149618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:39.150969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 669/1318] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:39.156232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826dc90-e883-400e-9d50-202055056ec3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:39.156655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826dc90-e883-400e-9d50-202055056ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:39.156803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826dc90-e883-400e-9d50-202055056ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:39.223344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a826dc90-e883-400e-9d50-202055056ec3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:39.224564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a826dc90-e883-400e-9d50-202055056ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:39.320172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 650/1319] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:39.603417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:39.605569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:39.709317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb736f52-4ea3-41cd-9d76-f7e4beab9ba2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:39.784150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:39.784745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:39.785047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:39.785315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:39.786934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:39.794771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:39.895555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:39.896953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe386847-353e-48d8-83b0-cc1ed9baee9f service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:39.915038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 670/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:42.493409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e00884-b057-4d91-b396-c6281c0d8364 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:42.493998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e00884-b057-4d91-b396-c6281c0d8364 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:42.493998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e00884-b057-4d91-b396-c6281c0d8364 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:42.496092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 651/1321] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:42.501218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ad5-6d47-41c5-a138-554cf3aa6b70 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:42.501613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ad5-6d47-41c5-a138-554cf3aa6b70 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:42.501876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ad5-6d47-41c5-a138-554cf3aa6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:42.570047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f9503ad5-6d47-41c5-a138-554cf3aa6b70 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:42.571253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f9503ad5-6d47-41c5-a138-554cf3aa6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:42.629914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:42.675667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 671/1322] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:35:42.979701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:42.980053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:42.980826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:42.982112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 652/1323] 10.222.0.70 () {54 vars in 965 bytes} [Wed Aug 31 10:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:42.988850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1fff-aa89-4b85-89a4-13b0c5eab07d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:42.989205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1fff-aa89-4b85-89a4-13b0c5eab07d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:42.989544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1fff-aa89-4b85-89a4-13b0c5eab07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:43.066335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-85fb1fff-aa89-4b85-89a4-13b0c5eab07d None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:43.067456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-85fb1fff-aa89-4b85-89a4-13b0c5eab07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:43.144971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 672/1324] 10.222.0.70 () {58 vars in 1062 bytes} [Wed Aug 31 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:43.154589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:43.156056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:43.175603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:43.263149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e9767-0568-41c8-9991-d301e23cacdf None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:43.339902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:43.340518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:43.340824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:43.341097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:43.342727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:43.415010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:43.454203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:43.455653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36b88-e22d-469b-a89c-1d70f8d4a96c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:43.473970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 653/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:45.670947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:45.671523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:45.671523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:45.672922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 673/1326] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:45.678774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fc2-0156-47f5-95c3-2dba488f1ed7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:45.679333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fc2-0156-47f5-95c3-2dba488f1ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:45.679333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec987fc2-0156-47f5-95c3-2dba488f1ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:45.747224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ec987fc2-0156-47f5-95c3-2dba488f1ed7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:45.748419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec987fc2-0156-47f5-95c3-2dba488f1ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:45.848451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 654/1327] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:46.131399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:46.133049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:46.196087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:46.240640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6b2b3-83d8-422b-b759-ee82120a08bb None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:46.317196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:46.317796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:46.318071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:46.318338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:46.319923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:46.434310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:46.436815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:46.438611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555a3db-5213-499b-8f8f-9dca4e835a7e service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:46.457408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 674/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:48.432655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:48.433200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:48.433307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:48.434568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 655/1329] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:48.439908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126bd1-64ce-4ba3-b954-446e81685783 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:48.440292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126bd1-64ce-4ba3-b954-446e81685783 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:48.440560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc126bd1-64ce-4ba3-b954-446e81685783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:48.519309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cc126bd1-64ce-4ba3-b954-446e81685783 None None] MFA Rules not processed for user `7054692c5f5d4267963f967598c9045d`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:48.520613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cc126bd1-64ce-4ba3-b954-446e81685783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:48.628974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 675/1330] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:48.909908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:48.911441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:48.943144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:49.021870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03216e91-60df-42af-945e-a50de09d76a4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:49.098367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:49.098972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:49.099601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:49.099601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:49.101125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:49.186735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:49.224690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:49.226196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2b4db-af70-4c35-90f6-61c4b724120e service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:49.249224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 656/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:51.601216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:51.601779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:51.601779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:51.603271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 676/1332] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:51.608599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ff51-ef9a-4b13-bbca-f3865ae4944d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:51.609072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ff51-ef9a-4b13-bbca-f3865ae4944d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:51.609185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ff51-ef9a-4b13-bbca-f3865ae4944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:51.675987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4a07ff51-ef9a-4b13-bbca-f3865ae4944d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:51.677245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4a07ff51-ef9a-4b13-bbca-f3865ae4944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:51.778716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 657/1333] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:52.059782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:52.061351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:52.131213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:52.165485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9fb0-ead6-424c-bad1-4c2c1f004ddf None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:52.238784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:52.239380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:52.239747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:52.239914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:52.241526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:52.350306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:52.351729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe915fd-8a09-4bbe-82ed-bbfe88651477 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:52.361435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:52.370425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 677/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:54.330679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:54.331244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:54.331244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:54.332600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 658/1335] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:54.337744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5f70-75a8-4839-8036-b331cbf4d663 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:54.338197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5f70-75a8-4839-8036-b331cbf4d663 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:54.338378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec5f70-75a8-4839-8036-b331cbf4d663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:54.403416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-26ec5f70-75a8-4839-8036-b331cbf4d663 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:54.404598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-26ec5f70-75a8-4839-8036-b331cbf4d663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:54.499140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 678/1336] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:54.789452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:54.791063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:54.831158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:54.893765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c10f08-ccb2-419d-b44e-a861a087a7ed None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:54.966895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:54.967491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:54.967767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:54.968033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:54.969641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:55.053770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:55.080069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:55.081524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae7105-55ce-4b1a-a553-cf68014fa821 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:55.099449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 659/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:35:57.477319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:57.477899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:57.477899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:57.479808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 679/1338] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:35:57.484945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565f4e-6514-40c0-922a-7a4d8d87aa7e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:57.485370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565f4e-6514-40c0-922a-7a4d8d87aa7e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:57.485497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565f4e-6514-40c0-922a-7a4d8d87aa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:57.551647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-df565f4e-6514-40c0-922a-7a4d8d87aa7e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:35:57.552893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-df565f4e-6514-40c0-922a-7a4d8d87aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:57.654789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 660/1339] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:35:57.930592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:35:57.932645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:58.007188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:35:58.036138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fce814-4fe2-46e4-956c-1d99a02a2929 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:35:58.118189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:35:58.118790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:35:58.119066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:35:58.119976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:35:58.121600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:35:58.227856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:35:58.229873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed557452-837c-48d3-9508-e9a7b72dec66 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:35:58.247969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 680/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:02.198062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:02.198496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:02.198727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:02.200106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 661/1341] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:02.205543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7fd8f-11b3-4bd8-97b7-c43fc7492079 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:02.205952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7fd8f-11b3-4bd8-97b7-c43fc7492079 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:02.206087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7fd8f-11b3-4bd8-97b7-c43fc7492079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:02.211473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:02.277517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-38e7fd8f-11b3-4bd8-97b7-c43fc7492079 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:02.278720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-38e7fd8f-11b3-4bd8-97b7-c43fc7492079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:02.378646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 681/1342] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:02.677689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:02.679209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:02.730430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:02.793060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12346f3a-1e15-47a0-9b83-229b5510e8f0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:02.868911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:02.870431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:02.870715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:02.870989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:02.872593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:02.968733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:02.986356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:02.987810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a6d3f-7883-49e7-8f1e-f3941bf74cc7 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:03.007104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 662/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:05.565839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:05.566502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:05.566502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:05.567733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 682/1344] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:05.573956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e04b0-241a-4ebb-91bc-f9555864c538 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:05.574574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e04b0-241a-4ebb-91bc-f9555864c538 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:05.574574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e04b0-241a-4ebb-91bc-f9555864c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:05.647666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ac8e04b0-241a-4ebb-91bc-f9555864c538 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:05.648919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ac8e04b0-241a-4ebb-91bc-f9555864c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:05.751224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 663/1345] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:06.039021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:06.040556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:06.131485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:06.149421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261fabe-7acb-41af-b2cf-e05fb7f9b829 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:06.224217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:06.224857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:06.225139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:06.225412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:06.227001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:06.351908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:06.353995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000e33d-d343-4785-b7d7-a197421d6cc4 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:06.373218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 683/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:10.255099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:10.255643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:10.255732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:10.257092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 664/1347] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:10.263229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b0b6-cf9a-4169-8e61-d5b8c6b42e8d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:10.263673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b0b6-cf9a-4169-8e61-d5b8c6b42e8d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:10.263780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0b0b6-cf9a-4169-8e61-d5b8c6b42e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:10.280844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:10.333351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f9e0b0b6-cf9a-4169-8e61-d5b8c6b42e8d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:10.334483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f9e0b0b6-cf9a-4169-8e61-d5b8c6b42e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:10.433073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 684/1348] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:10.718216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:10.719831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:10.782265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:10.835780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f1fa2-8c31-47fd-990d-c45892fba718 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:10.913381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:10.913982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:10.914264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:10.914534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:10.916863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:11.037214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:11.043058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:11.044651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8220b8d-9061-4ad4-978e-5733a95a3d93 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:11.064330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 665/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:16.133108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a822-a22a-4e89-b320-0d75dddc8113 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:16.135265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a822-a22a-4e89-b320-0d75dddc8113 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:16.135691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545a822-a22a-4e89-b320-0d75dddc8113 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:16.140170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 685/1350] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:36:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:16.145776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563615-dc53-44fd-a145-ad66b38a573f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:16.146211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563615-dc53-44fd-a145-ad66b38a573f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:16.146330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2563615-dc53-44fd-a145-ad66b38a573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:16.246442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f2563615-dc53-44fd-a145-ad66b38a573f None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:16.248239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f2563615-dc53-44fd-a145-ad66b38a573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:16.439764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 666/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:20.430723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=59 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:20.715402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574dca-fdd3-4a53-b938-fab3cffd75e2 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:20.715780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574dca-fdd3-4a53-b938-fab3cffd75e2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:20.716132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18574dca-fdd3-4a53-b938-fab3cffd75e2 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:20.717804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 686/1352] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:20.723434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08993-9b1d-4660-ae67-10bf96b971aa None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:20.723892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08993-9b1d-4660-ae67-10bf96b971aa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:20.724013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08993-9b1d-4660-ae67-10bf96b971aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:20.782935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:20.816340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-79c08993-9b1d-4660-ae67-10bf96b971aa None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:20.817603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-79c08993-9b1d-4660-ae67-10bf96b971aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:20.932656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 667/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:36:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:22.376223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ac2-e737-4cbc-8deb-e1867e5b40a0 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:22.376935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ac2-e737-4cbc-8deb-e1867e5b40a0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:22.376935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8ac2-e737-4cbc-8deb-e1867e5b40a0 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:22.378356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 687/1354] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:22.384107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d34b-f9ac-4cd0-ab84-e826279bc199 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:22.384628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d34b-f9ac-4cd0-ab84-e826279bc199 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:22.385279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d34b-f9ac-4cd0-ab84-e826279bc199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:22.474050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7b51d34b-f9ac-4cd0-ab84-e826279bc199 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:22.475270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7b51d34b-f9ac-4cd0-ab84-e826279bc199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:22.522724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:22.598369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 668/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:36:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:36:26.090923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d80e-18b5-45b1-b072-5961be83586b None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:26.091455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d80e-18b5-45b1-b072-5961be83586b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:26.091455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d80e-18b5-45b1-b072-5961be83586b None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:26.092929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 688/1356] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:26.097994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3edf37-b81e-4ace-af1f-b9ac2498f11a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:26.098732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3edf37-b81e-4ace-af1f-b9ac2498f11a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:26.099181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3edf37-b81e-4ace-af1f-b9ac2498f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:26.176058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bf3edf37-b81e-4ace-af1f-b9ac2498f11a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:26.177380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bf3edf37-b81e-4ace-af1f-b9ac2498f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:26.331589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 669/1357] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:26.635752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:26.636036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:26.636486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:26.638097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 689/1358] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 31 10:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:26.644920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671d4-ed51-4663-a793-28e09ecd16c3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:26.645242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671d4-ed51-4663-a793-28e09ecd16c3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:26.645475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208671d4-ed51-4663-a793-28e09ecd16c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:26.664412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:26.732156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-208671d4-ed51-4663-a793-28e09ecd16c3 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:26.733340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-208671d4-ed51-4663-a793-28e09ecd16c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:26.871818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 670/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 31 10:36:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:36:26.879789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:26.881553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:27.041311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57f79-b5d7-47e1-bd00-dbc975ebca31 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:27.118548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:27.160952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:27.161574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:27.161844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:27.162113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:27.163691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:27.261224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:27.262845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f982e51-cb0e-4514-9c77-7f3170577b92 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:27.282109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 690/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:29.471303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:29.471817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:29.471817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:29.473312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 671/1361] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:29.479184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb37-615d-4c03-a723-6ee5e7ade8f5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:29.479636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb37-615d-4c03-a723-6ee5e7ade8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:29.479728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6efb37-615d-4c03-a723-6ee5e7ade8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:29.551934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2a6efb37-615d-4c03-a723-6ee5e7ade8f5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:29.553584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2a6efb37-615d-4c03-a723-6ee5e7ade8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:29.594524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:29.681234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 691/1362] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:29.972998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:29.972998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:30.058327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:30.148080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c7fa5-3fa8-4b60-aa98-efd50532b8c4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:30.275526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:30.276146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:30.276426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:30.276702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:30.278385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:30.303713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:30.380069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:30.381759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab1729-189a-4bbd-93fe-b0e80bd61e2b service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:30.405024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 672/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:32.685280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cd47c-405a-4412-8d4f-66589f88053d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:32.685835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cd47c-405a-4412-8d4f-66589f88053d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:32.685835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cd47c-405a-4412-8d4f-66589f88053d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:32.687347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 692/1364] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:32.692792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf801-9726-48e4-bc55-33dd067c30f6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:32.693572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf801-9726-48e4-bc55-33dd067c30f6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:32.693848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bf801-9726-48e4-bc55-33dd067c30f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:32.766338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-928bf801-9726-48e4-bc55-33dd067c30f6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:32.767614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-928bf801-9726-48e4-bc55-33dd067c30f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:32.881874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:32.892821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 673/1365] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:33.181242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103658d-5389-4f78-9291-508db9d50991 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:33.181535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103658d-5389-4f78-9291-508db9d50991 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:33.182022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103658d-5389-4f78-9291-508db9d50991 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:33.183451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 693/1366] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 31 10:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:33.188722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4fc7-d850-4321-ad6b-7d344718f874 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:33.189041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4fc7-d850-4321-ad6b-7d344718f874 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:33.189315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4fc7-d850-4321-ad6b-7d344718f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:33.271009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a63b4fc7-d850-4321-ad6b-7d344718f874 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:33.272138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a63b4fc7-d850-4321-ad6b-7d344718f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:33.396703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 674/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 31 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:33.404831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103658d-5389-4f78-9291-508db9d50991 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:33.406865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5103658d-5389-4f78-9291-508db9d50991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:33.589963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103658d-5389-4f78-9291-508db9d50991 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:33.611583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:33.710819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:33.711660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:33.711941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:33.712130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:33.713740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:33.808952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:33.810594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78358f99-d017-4256-90d6-1804b5315898 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:33.835344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 694/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:34.376037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862278f9-3daf-44c0-af18-7e42ad67f14f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:34.376609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862278f9-3daf-44c0-af18-7e42ad67f14f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:34.376609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862278f9-3daf-44c0-af18-7e42ad67f14f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:34.378130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 675/1369] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:34.383022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2779bd-e097-48c2-a34f-58018116fdf5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:34.383370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2779bd-e097-48c2-a34f-58018116fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:34.384211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2779bd-e097-48c2-a34f-58018116fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:34.416370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:34.454406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-eb2779bd-e097-48c2-a34f-58018116fdf5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:34.455601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eb2779bd-e097-48c2-a34f-58018116fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:34.565222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 695/1370] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:35.153442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:35.153442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:35.153442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:35.155792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 676/1371] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 31 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:35.160732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669e0-831a-481f-a465-81c9e26334af None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:35.160732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669e0-831a-481f-a465-81c9e26334af None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:35.160732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98669e0-831a-481f-a465-81c9e26334af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:35.236209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d98669e0-831a-481f-a465-81c9e26334af None None] MFA Rules not processed for user `252058d963a641a68e526a016ff50031`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:35.237430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d98669e0-831a-481f-a465-81c9e26334af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:35.287455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:35.320437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 696/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 31 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:36:35.328731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:35.330336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:35.385162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:35.441547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a43818-64d0-49f3-9381-5b85f64e3d58 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:35.521020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:35.521622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:35.521896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:35.522164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:35.523742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:35.633098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:35.649606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:35.651158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf4bd-ac80-4302-a103-0c452f7b1c6b service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:35.675248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 677/1373] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:35.849583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:35.849874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:35.850327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:35.852513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 697/1374] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:35.859308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158546-6fa6-476e-918f-a8c47a14ad5f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:35.859594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158546-6fa6-476e-918f-a8c47a14ad5f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:35.859873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34158546-6fa6-476e-918f-a8c47a14ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:35.942295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-34158546-6fa6-476e-918f-a8c47a14ad5f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:35.943883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-34158546-6fa6-476e-918f-a8c47a14ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:36.061289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 678/1375] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:36.377778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:36.379427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:36.532504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3211879-2400-41d6-bc8d-e88bab0d4ebd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:36.585745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:36.648739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:36.649978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:36.650256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:36.650527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:36.652122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:36.744147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:36.745764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34ba31-2398-4b6e-81e8-c3250d0386e1 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:36.764261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 698/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:38.739787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:38.740330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:38.740330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:38.741879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 679/1377] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:38.748141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e43-7d94-4675-96a0-d45ed05d3413 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:38.748568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e43-7d94-4675-96a0-d45ed05d3413 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:38.748674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e43-7d94-4675-96a0-d45ed05d3413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:38.842646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3ad90e43-7d94-4675-96a0-d45ed05d3413 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:38.843849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3ad90e43-7d94-4675-96a0-d45ed05d3413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:38.850910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:38.944501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 699/1378] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:39.255202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:39.255531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:39.333226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:39.425276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55495ef-8eb0-456a-9fa2-e77c5c206c59 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:39.552195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:39.552830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:39.553114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:39.553393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:39.555019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:39.575463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:39.654348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:39.655965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db78890-3dfe-4403-9e5a-e43d54c6f86e service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:39.676827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 680/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:41.657338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:41.657791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:41.657885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:41.660206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 700/1380] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:41.665903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31883a-c863-4896-970b-2ec83d073dce None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:41.666498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31883a-c863-4896-970b-2ec83d073dce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:41.666498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31883a-c863-4896-970b-2ec83d073dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:41.745772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3e31883a-c863-4896-970b-2ec83d073dce None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:41.746968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3e31883a-c863-4896-970b-2ec83d073dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:41.850859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:41.860805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 681/1381] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:42.157492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:42.159021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:42.313863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:42.325903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2da8ec-60d6-4760-ad48-60c4fe3822fd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:42.450241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:42.450816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:42.451092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:42.451356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:42.452941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:42.546070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:42.547667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c03078-128f-4a91-ad25-425b4208d90a service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:42.559000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:42.568477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 701/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:44.639159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:44.639785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:44.640893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:44.643608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 682/1383] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:44.649812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2ad4-8c01-46eb-88c1-8bd2005c7fce None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:44.650278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2ad4-8c01-46eb-88c1-8bd2005c7fce None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:44.650278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2ad4-8c01-46eb-88c1-8bd2005c7fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:44.740543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c2db2ad4-8c01-46eb-88c1-8bd2005c7fce None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:44.741841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c2db2ad4-8c01-46eb-88c1-8bd2005c7fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:44.856804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 702/1384] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:45.164817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:45.167734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:45.343259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d2388-d576-4d40-8983-99d89e4f50e3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:45.411752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:45.461392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:45.462004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:45.462283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:45.462550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:45.464156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:45.609189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:45.612337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f517aa-b9e0-402b-87fb-36401106a7c2 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:45.642375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 683/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:47.844360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:47.845210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:47.845210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:47.846312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 703/1386] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:47.851958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1e830-7102-4eb3-9e16-c7cd0387a7aa None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:47.852554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1e830-7102-4eb3-9e16-c7cd0387a7aa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:47.852789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1e830-7102-4eb3-9e16-c7cd0387a7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:47.924452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-aca1e830-7102-4eb3-9e16-c7cd0387a7aa None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:47.925774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-aca1e830-7102-4eb3-9e16-c7cd0387a7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:47.965126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:48.052874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 684/1387] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:48.363996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:48.365623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:48.447035 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:48.537747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def74197-2ef6-467d-add9-321b3cea6c2a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:48.655434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:48.655977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:48.656261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:48.656541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:48.658228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:48.698082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:48.769737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:48.771404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cf6c2-6f03-4206-848b-dbe29802592f service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:48.797841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 704/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:50.754850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:50.755427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:50.755427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:50.756740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 685/1389] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:50.761897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78700-7d5f-43de-a132-ca934e2e8c5c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:50.762307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78700-7d5f-43de-a132-ca934e2e8c5c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:50.762438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78700-7d5f-43de-a132-ca934e2e8c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:50.832644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-0fd78700-7d5f-43de-a132-ca934e2e8c5c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:50.833893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0fd78700-7d5f-43de-a132-ca934e2e8c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:50.929623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 705/1390] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:51.220797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:51.222425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:51.371706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2abb8-e882-4261-96c0-3e3f646ba8c3 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:51.389483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:51.495083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:51.495693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:51.495975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:51.496252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:51.497926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:51.526943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4223-6d68-4354-9757-f68d7b0e6526 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:51.527339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4223-6d68-4354-9757-f68d7b0e6526 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:51.527529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd4223-6d68-4354-9757-f68d7b0e6526 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:51.529014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 706/1391] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:36:51.534310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7777bbb-8f0e-4496-8bcd-40b3848145c2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:51.534663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7777bbb-8f0e-4496-8bcd-40b3848145c2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:51.534942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7777bbb-8f0e-4496-8bcd-40b3848145c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:51.552059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:51.593108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:51.594718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de355-dc85-4cdf-bd72-bcf6751fa194 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:51.606022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d7777bbb-8f0e-4496-8bcd-40b3848145c2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:51.607239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d7777bbb-8f0e-4496-8bcd-40b3848145c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:51.613261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 686/1392] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:51.718893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 707/1393] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:52.028220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:52.028705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:52.028838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:52.030130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 687/1394] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 31 10:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:52.035143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677435c5-f1a3-4c35-9479-2eef8201a6c4 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:52.035587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677435c5-f1a3-4c35-9479-2eef8201a6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:52.035812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677435c5-f1a3-4c35-9479-2eef8201a6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:52.112837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-677435c5-f1a3-4c35-9479-2eef8201a6c4 None None] MFA Rules not processed for user `7089e9cdf205484b96a23fe75805d0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:52.114038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-677435c5-f1a3-4c35-9479-2eef8201a6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:52.149798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:52.191987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 708/1395] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 31 10:36:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:36:52.200153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:52.201608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:52.224770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:52.309043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b47764-e6a0-403c-b88d-52503ef4191f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:52.383353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:52.384087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:52.384365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:52.384634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:52.386261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:52.459857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:52.498415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:52.499859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d1ddd-b37d-434f-83a6-6d47d9bbcd53 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:52.518290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 688/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:53.267610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22f577-9585-4ca0-9da9-7103c8bfaff6 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.268152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22f577-9585-4ca0-9da9-7103c8bfaff6 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.268356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22f577-9585-4ca0-9da9-7103c8bfaff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.335843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fc22f577-9585-4ca0-9da9-7103c8bfaff6 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:53.337074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fc22f577-9585-4ca0-9da9-7103c8bfaff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:53.424091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 709/1397] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:53.471785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c62b-c8e6-4896-8623-9a57d9de50a3 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.472240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c62b-c8e6-4896-8623-9a57d9de50a3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.472471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337c62b-c8e6-4896-8623-9a57d9de50a3 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.474062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 689/1398] 10.222.0.70 () {54 vars in 943 bytes} [Wed Aug 31 10:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:53.481443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.481793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.482127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.545541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:53.566634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] MFA Rules not processed for user `c051c9e64b2b4d16958cf716d3f6ff36`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:53.567833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:53.591752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c126b-ad74-444e-be91-f35a3fa32cef None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.592433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c126b-ad74-444e-be91-f35a3fa32cef None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.593169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c126b-ad74-444e-be91-f35a3fa32cef None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.594542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 690/1399] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:36:53.599605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.599912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.600201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.669311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:53.670528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:53.677428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 710/1400] 10.222.0.70 () {58 vars in 1040 bytes} [Wed Aug 31 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:53.686826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:53.696531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff62ae-e4b9-4f20-9fc5-14c00d2a6b8a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:53.776218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 691/1401] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:36:53.800123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:53.806544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:53.807634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:53.808329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:53.808824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:53.810484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:53.895217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:53.896827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a5c0-73a0-46be-84b0-77a8be3f6125 service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:53.905071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 711/1402] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:36:54.081207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:54.082581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:54.118688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:54.211671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7db29-c075-4411-acab-7c06f39aab19 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:54.355271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:54.356046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:54.356427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:54.356851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:54.358557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:54.393129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:54.463455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:54.465095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3026441-0d19-4470-b364-dc6b054737f7 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:54.486246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 692/1403] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:56.486641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:56.487254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:56.487374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:56.488821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 712/1404] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:36:56.494622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6aa90-e03f-4bf0-a685-67708bc457b5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:56.495279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6aa90-e03f-4bf0-a685-67708bc457b5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:56.495279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6aa90-e03f-4bf0-a685-67708bc457b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:56.567658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f8f6aa90-e03f-4bf0-a685-67708bc457b5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:56.568903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f8f6aa90-e03f-4bf0-a685-67708bc457b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:56.680099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 693/1405] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:56.977697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:56.979527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:57.132976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:57.147494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dbb2c-81a6-4171-8380-e2db78d1ec87 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:36:57.271250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:36:57.271863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:57.272144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:57.272415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:57.274354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:57.374891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:36:57.376630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f596177-4ba6-4e58-850a-df793e1bd69c service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:36:57.387510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:36:57.396850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 713/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:36:59.374971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:59.375535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:59.375535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:59.376879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 694/1407] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:36:59.382063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e21-ab78-42d0-87db-2026f8b0405d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:36:59.382858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e21-ab78-42d0-87db-2026f8b0405d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:36:59.382858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c551e21-ab78-42d0-87db-2026f8b0405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:36:59.475115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3c551e21-ab78-42d0-87db-2026f8b0405d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:36:59.476737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3c551e21-ab78-42d0-87db-2026f8b0405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:59.613270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 714/1408] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:36:59.914613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:36:59.916552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:36:59.919884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:00.083348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42cb9-7e3c-447a-9b91-ccca1be8670b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:00.178058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:00.227022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:00.227729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:00.228006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:00.228276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:00.229897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:00.345198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:00.346768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80a7c-b328-4dad-a9ad-f32346d9ed60 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:00.366031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 695/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:37:09.611163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=67 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:10.363669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=61 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:16.173160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6a29-2cbb-4391-b587-72a1dadc6aed None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:16.173738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6a29-2cbb-4391-b587-72a1dadc6aed None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:16.173738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab6a29-2cbb-4391-b587-72a1dadc6aed None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:16.175027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 715/1410] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 31 10:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:16.180401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92203-2b84-42cf-ad80-992206e1e8f5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:16.180875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92203-2b84-42cf-ad80-992206e1e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:16.180983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92203-2b84-42cf-ad80-992206e1e8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:16.256587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c5f92203-2b84-42cf-ad80-992206e1e8f5 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:16.258452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c5f92203-2b84-42cf-ad80-992206e1e8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:16.364055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 696/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 31 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:16.378824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c340-8dee-41ae-b8ca-c4e8390b6e50 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:16.379107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c340-8dee-41ae-b8ca-c4e8390b6e50 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:16.379380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95c340-8dee-41ae-b8ca-c4e8390b6e50 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:16.380695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 716/1412] 10.222.0.70 () {54 vars in 918 bytes} [Wed Aug 31 10:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:16.386182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f514-674c-4afb-8b83-ca70a1776147 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:16.386468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f514-674c-4afb-8b83-ca70a1776147 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:16.386741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8f514-674c-4afb-8b83-ca70a1776147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:16.458946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:16.462689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-43d8f514-674c-4afb-8b83-ca70a1776147 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:16.464477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43d8f514-674c-4afb-8b83-ca70a1776147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:16.582156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 697/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 31 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:18.993922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:18.994559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:18.994559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:18.995850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:19.001280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f724b-60f7-4a8b-937a-2f918397f096 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:19.001682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f724b-60f7-4a8b-937a-2f918397f096 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:19.001874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f724b-60f7-4a8b-937a-2f918397f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:19.070755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4c9f724b-60f7-4a8b-937a-2f918397f096 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:19.071902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c9f724b-60f7-4a8b-937a-2f918397f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:19.128043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:19.170440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:19.470856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:19.472435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:19.618648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38abf43-8f82-41cd-a54f-abe1f793f88d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:19.689673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:19.729553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:19.730075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:19.730343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:19.730606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:19.732186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:19.821836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:19.823466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0631dc-a3c4-40f0-b24e-4062b7d0ebe4 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:19.841226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 718/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:20.722340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:20.722908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:20.722908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:20.724288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:20.729265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651df1-1670-43c2-968c-0b555a4a6edf None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:20.729678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651df1-1670-43c2-968c-0b555a4a6edf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:20.729841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58651df1-1670-43c2-968c-0b555a4a6edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:20.806956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-58651df1-1670-43c2-968c-0b555a4a6edf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:20.808153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-58651df1-1670-43c2-968c-0b555a4a6edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:20.834892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:20.904626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:21.052720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:21.054786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:21.203307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36732ca8-e2b0-485a-ba0f-5bb415bb8a7e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:21.242565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:21.319399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:21.320498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:21.320872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:21.321158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:21.322765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:21.412913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:21.414618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7155b3-53cc-413b-8bcb-939fdc730aab service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:21.432443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 700/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:22.320105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:22.321262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:22.321262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:22.322171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:22.327212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1e66-ffe7-484c-96aa-bffb408ae2f2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:22.327651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1e66-ffe7-484c-96aa-bffb408ae2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:22.327755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba1e66-ffe7-484c-96aa-bffb408ae2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:22.384323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:22.407212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3bba1e66-ffe7-484c-96aa-bffb408ae2f2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:22.408442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bba1e66-ffe7-484c-96aa-bffb408ae2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:22.504845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:22.657628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:22.659173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:22.808131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb069dd4-ff59-4acf-b171-8d07636f10c9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:22.821329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:22.927686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a034465-21df-4980-b427-deb339be73bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:22.928198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a034465-21df-4980-b427-deb339be73bf service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:22.928477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a034465-21df-4980-b427-deb339be73bf service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:22.928747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a034465-21df-4980-b427-deb339be73bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:22.930990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0a034465-21df-4980-b427-deb339be73bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:23.032721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a034465-21df-4980-b427-deb339be73bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:23.034318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a034465-21df-4980-b427-deb339be73bf service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:23.052016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 721/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:23.964104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:23.964638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:23.964638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:23.966029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:23.970840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704e0c2-8096-4d44-a15b-0e1080fbfd2d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:23.971299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704e0c2-8096-4d44-a15b-0e1080fbfd2d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:23.971407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704e0c2-8096-4d44-a15b-0e1080fbfd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:23.991031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:24.048067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8704e0c2-8096-4d44-a15b-0e1080fbfd2d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:24.049318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8704e0c2-8096-4d44-a15b-0e1080fbfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:24.148928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:24.300704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:24.302314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:24.418399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:24.456157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004ff29-c162-48f4-b574-40d93a07e297 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:24.572361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:24.572986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:24.573262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:24.573529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:24.575117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:24.651259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:24.665334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:24.666930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e29a34-64c8-4290-bada-346a1c78f158 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:24.684978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 703/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:25.547301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:25.547881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:25.547881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:25.549273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:25.554795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a9bc-15ce-446f-8601-621e64a505cf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:25.555227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a9bc-15ce-446f-8601-621e64a505cf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:25.555338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a9bc-15ce-446f-8601-621e64a505cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:25.631651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b619a9bc-15ce-446f-8601-621e64a505cf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:25.633449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b619a9bc-15ce-446f-8601-621e64a505cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:25.727955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:25.885641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:25.887145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:25.971262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:26.036905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5f91b-ae0a-4c3f-9f97-8e67a736da70 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:26.147508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03065d83-2dda-4055-9108-d020caff337b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:26.148225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065d83-2dda-4055-9108-d020caff337b service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:26.148493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065d83-2dda-4055-9108-d020caff337b service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:26.148788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03065d83-2dda-4055-9108-d020caff337b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:26.150366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-03065d83-2dda-4055-9108-d020caff337b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:26.198977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:26.240941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065d83-2dda-4055-9108-d020caff337b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:26.243200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03065d83-2dda-4055-9108-d020caff337b service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:26.261597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 724/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:27.071955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:27.072469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:27.072469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:27.073810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:27.078741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd82f-800a-4f4d-b22d-3355ab6b7dca None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:27.079191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd82f-800a-4f4d-b22d-3355ab6b7dca None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:27.079298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cd82f-800a-4f4d-b22d-3355ab6b7dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:27.157398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2e1cd82f-800a-4f4d-b22d-3355ab6b7dca None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:27.158857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2e1cd82f-800a-4f4d-b22d-3355ab6b7dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:27.256017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:27.413137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:27.414709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:27.463789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:27.560737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3430b-2b05-4b77-8530-0df5875abb56 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:27.672897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:27.673427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:27.673705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:27.673980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:27.675579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:27.683066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:27.766139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:27.767740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8dc6-500e-49e4-b8f7-fbe10d877e5c service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:27.785723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 706/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:28.597773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:28.598306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:28.598306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:28.599669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:28.606215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65ee-080c-48e3-9df8-c99c2d481505 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:28.606689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65ee-080c-48e3-9df8-c99c2d481505 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:28.606794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a65ee-080c-48e3-9df8-c99c2d481505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:28.683574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-648a65ee-080c-48e3-9df8-c99c2d481505 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:28.684802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-648a65ee-080c-48e3-9df8-c99c2d481505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:28.751819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:28.781996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:28.933827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:28.935409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:28.953135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:29.084557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b0648-c301-4065-a155-86c579c12209 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:29.178340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:29.205302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:29.206765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:29.206765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:29.206765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:29.207790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:29.297805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:29.299419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577da37-05ec-4cf4-a42c-f78296a47e3c service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:29.317690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 727/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:30.128016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:30.128573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:30.128573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:30.129972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:30.135629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cc159-b7cc-4641-8fe4-ed0b665c7bd4 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:30.136066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cc159-b7cc-4641-8fe4-ed0b665c7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:30.136178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cc159-b7cc-4641-8fe4-ed0b665c7bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:30.212076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-042cc159-b7cc-4641-8fe4-ed0b665c7bd4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:30.213505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-042cc159-b7cc-4641-8fe4-ed0b665c7bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:30.254963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:30.310729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:30.464949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:30.466376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:30.611836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa089e-7ac3-4ee5-9e33-bc55272bff49 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:30.666688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:30.725355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:30.725883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:30.726168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:30.726427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:30.728009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:30.819041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:30.820749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649be11a-cf92-40d5-8fe5-ec20f4b907df service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:30.842363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 709/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:31.651603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:31.652239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:31.652239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:31.653565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:31.658485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5fb3-585e-4538-aec1-99b691edffba None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:31.658933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5fb3-585e-4538-aec1-99b691edffba None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:31.659033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5fb3-585e-4538-aec1-99b691edffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:31.734724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3fcc5fb3-585e-4538-aec1-99b691edffba None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:31.735944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3fcc5fb3-585e-4538-aec1-99b691edffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:31.737992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:31.834796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:31.987944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:31.989583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:32.135998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f64b55-3cf7-4ada-b3bd-dbfd91b92b87 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:32.162730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:32.249759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:32.250361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:32.250636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:32.250903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:32.252484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:32.352285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:32.353912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c374f-27f4-4514-8d7f-0f369c5126e6 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:32.372706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 730/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:34.207597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:34.208190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:34.208190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:34.209534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:34.215608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3c23-4f32-4eea-bcc8-7619a32e4f05 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:34.216059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3c23-4f32-4eea-bcc8-7619a32e4f05 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:34.216164 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3c23-4f32-4eea-bcc8-7619a32e4f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:34.256152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:34.283746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-880f3c23-4f32-4eea-bcc8-7619a32e4f05 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:34.284974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-880f3c23-4f32-4eea-bcc8-7619a32e4f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:34.384338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:34.671610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:34.673167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:34.781085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fe9a8-9e89-4bff-9a4a-6855e7a32b60 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:34.814459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:34.856743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:34.857366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:34.857644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:34.857913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:34.859496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:34.966644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:34.968006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3e8a-415d-4069-b28a-3011d045f88b service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:34.986165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 712/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:37.116723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:37.117800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:37.117899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:37.119212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:37.124375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345278-0552-4794-8714-e4f3d7a3b0e6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:37.124826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345278-0552-4794-8714-e4f3d7a3b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:37.124961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0345278-0552-4794-8714-e4f3d7a3b0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:37.192387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f0345278-0552-4794-8714-e4f3d7a3b0e6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:37.193624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f0345278-0552-4794-8714-e4f3d7a3b0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:37.206430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:37.295488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:37.580981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:37.582552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:37.686283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc8d1c-20d1-491a-a717-c752315c7c7e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:37.698716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:37.759868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:37.760460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:37.760732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:37.761020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:37.762595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:37.988716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:37.990220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f73f84-440a-499c-95eb-304cb6e02f7f service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:38.009891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 733/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:40.245468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b05f-e705-4373-991a-38eb06547195 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:40.246027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b05f-e705-4373-991a-38eb06547195 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:40.246027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364b05f-e705-4373-991a-38eb06547195 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:40.247373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:40.252596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5fe02-19b8-4e5c-b18b-8068e9a57805 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:40.253048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5fe02-19b8-4e5c-b18b-8068e9a57805 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:40.253180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5fe02-19b8-4e5c-b18b-8068e9a57805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:40.301364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:40.319701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-23d5fe02-19b8-4e5c-b18b-8068e9a57805 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:40.320961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-23d5fe02-19b8-4e5c-b18b-8068e9a57805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:40.418675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:40.707340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b05f-e705-4373-991a-38eb06547195 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:40.708987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9364b05f-e705-4373-991a-38eb06547195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:40.818829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364b05f-e705-4373-991a-38eb06547195 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:40.859405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:40.894348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:40.894947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:40.895224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:40.895492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:40.897107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:41.005320 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:41.006682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407d3d6-ad24-4807-890b-320b35bc79c6 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:41.025379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 715/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:43.063648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:43.064082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:43.064194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:43.065779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:43.071660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242a8c-0494-4999-807a-ec90bee0e669 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:43.072116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242a8c-0494-4999-807a-ec90bee0e669 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:43.072224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242a8c-0494-4999-807a-ec90bee0e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:43.139804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e4242a8c-0494-4999-807a-ec90bee0e669 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:43.141366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e4242a8c-0494-4999-807a-ec90bee0e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:43.162573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:43.241172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:43.533239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:43.534773 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:43.636037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f9abd-041d-49a9-8ffb-a0162498ff1e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:43.656745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:43.709584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:43.710174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:43.710986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:43.711422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:43.713038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:43.826694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:43.828120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48d92a-4711-4444-9a7a-44b095efc912 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:43.847178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 736/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:45.833351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:45.833976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:45.834433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:45.836415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:45.842003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3543e-3f93-4342-9b55-5c0451b632a9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:45.842444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3543e-3f93-4342-9b55-5c0451b632a9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:45.842612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3543e-3f93-4342-9b55-5c0451b632a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:45.905545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:45.908237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-89b3543e-3f93-4342-9b55-5c0451b632a9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:45.910260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-89b3543e-3f93-4342-9b55-5c0451b632a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:46.007238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:46.298524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:46.300069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:46.403382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc9e89-704d-41c3-847c-6d0e59b48375 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:46.452435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:46.477258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:46.477869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:46.478148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:46.478420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:46.480028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:46.590846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:46.592344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19815-bf28-490a-b293-02cac93dd392 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:46.610479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 718/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:48.614542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:48.615080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:48.615208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:48.616432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:48.622468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed936d6-ea8f-4c8d-89d3-bb85fcf12268 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:48.622915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed936d6-ea8f-4c8d-89d3-bb85fcf12268 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:48.623013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed936d6-ea8f-4c8d-89d3-bb85fcf12268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:48.689652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fed936d6-ea8f-4c8d-89d3-bb85fcf12268 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:48.690851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fed936d6-ea8f-4c8d-89d3-bb85fcf12268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:48.720028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:48.788389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:49.079556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:49.081129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:49.182192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798e1fd-353a-4fe3-b04b-180872b69628 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:49.209722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:49.254262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:49.254855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:49.255128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:49.255394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:49.257012 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:49.363788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:49.365243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a411e-af6f-4a15-877d-f9bc86295e59 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:49.384171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 739/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:51.369426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:51.369983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:51.369983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:51.371298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:51.376570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177652-bdcd-426a-b407-199af153b65a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:51.377018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177652-bdcd-426a-b407-199af153b65a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:51.377267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e177652-bdcd-426a-b407-199af153b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:51.441709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2e177652-bdcd-426a-b407-199af153b65a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:51.442909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2e177652-bdcd-426a-b407-199af153b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:51.451040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:51.537319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:51.826407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:51.827930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:51.932474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dafae0-4b89-43fb-99c7-1e447f883132 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:51.990776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:52.009485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:52.010078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:52.010349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:52.010613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:52.012191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:52.122146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:52.123601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e88b7-8758-488e-ae73-1d6a8b751a17 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:52.142255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 721/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:54.106713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:54.107235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:54.107235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:54.108585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:54.113854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6254-cb58-4f60-88f1-129c895006a0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:54.114278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6254-cb58-4f60-88f1-129c895006a0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:54.114401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6254-cb58-4f60-88f1-129c895006a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:54.180262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d56e6254-cb58-4f60-88f1-129c895006a0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:54.181485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d56e6254-cb58-4f60-88f1-129c895006a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:54.221671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:54.280705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:54.571496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:54.573043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:54.675429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866f57-a9a6-49ce-9ac6-3ed19409f317 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:54.712082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:54.748103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:54.748698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:54.749003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:54.749353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:54.750926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:54.861791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:54.863212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6065e0-8195-4f53-9556-9e537dd0ba88 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:54.880680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 742/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:56.828696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:56.829166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:56.829291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:56.830660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:56.835892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7694-fad2-42a2-b3f6-8044373597cd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:56.836299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7694-fad2-42a2-b3f6-8044373597cd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:56.836434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7694-fad2-42a2-b3f6-8044373597cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:56.904362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-670d7694-fad2-42a2-b3f6-8044373597cd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:56.905575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-670d7694-fad2-42a2-b3f6-8044373597cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:56.923732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:57.000613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:37:57.291279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:37:57.292839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:57.399901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b243f5-9ee9-4b43-b33f-ddaa81ec07e5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:37:57.466076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:57.473371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:37:57.473968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:57.474242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:57.474508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:57.476654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:57.585236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:37:57.586875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f7829-1c8e-40d8-befd-7e771082c914 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:37:57.605006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 724/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:37:59.583621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:59.584183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:59.584183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:59.586579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:37:59.591619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dcbf6-658a-4478-88ce-ba402ae80135 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:37:59.592071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dcbf6-658a-4478-88ce-ba402ae80135 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:37:59.592172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dcbf6-658a-4478-88ce-ba402ae80135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:37:59.659170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-373dcbf6-658a-4478-88ce-ba402ae80135 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:37:59.660439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-373dcbf6-658a-4478-88ce-ba402ae80135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:37:59.712794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:37:59.761501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:00.056648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:00.058251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:00.163028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476c330-591b-49f0-a61f-5d6d47f59d6d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:00.209709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:00.237646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:00.238253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:00.238527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:00.238798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:00.241843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:00.357929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:00.359338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405e045-9377-4569-b6b2-4386f351c42f service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:00.377560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 745/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:09.759673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=22 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:10.375299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=66 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:20.156201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa9fa-06c5-4d74-b31a-a3ab9d4fe3a9 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:20.156742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa9fa-06c5-4d74-b31a-a3ab9d4fe3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:20.156742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fa9fa-06c5-4d74-b31a-a3ab9d4fe3a9 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:20.158100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 726/1471] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:20.163939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7e0f-eeee-4519-85e9-2e615f9f2b93 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:20.164583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7e0f-eeee-4519-85e9-2e615f9f2b93 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:20.164778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7e0f-eeee-4519-85e9-2e615f9f2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:20.230544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-661a7e0f-eeee-4519-85e9-2e615f9f2b93 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:20.231737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-661a7e0f-eeee-4519-85e9-2e615f9f2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:20.334191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 746/1472] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:20.631686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:20.631970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:20.632301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:20.633657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 727/1473] 10.222.0.70 () {54 vars in 967 bytes} [Wed Aug 31 10:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:20.638458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39a93-5a80-411f-9c1b-5363b28c4777 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:20.638739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39a93-5a80-411f-9c1b-5363b28c4777 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:20.639008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed39a93-5a80-411f-9c1b-5363b28c4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:20.725383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7ed39a93-5a80-411f-9c1b-5363b28c4777 None None] MFA Rules not processed for user `7089e9cdf205484b96a23fe75805d0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:20.727187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7ed39a93-5a80-411f-9c1b-5363b28c4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:20.748101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:20.804691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 747/1474] 10.222.0.70 () {58 vars in 1064 bytes} [Wed Aug 31 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:20.812230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:20.813800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:20.924573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83d1d9-b5c4-4b3d-a598-a8033aba2b8a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:20.998729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:20.999325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:20.999601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:20.999869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:21.001470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:21.057027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:21.118340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:21.119878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70a7a2-fd45-4ecd-8233-ea986dde4983 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:21.138607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 728/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:23.153771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:23.154330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:23.154330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:23.155651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 748/1476] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:23.160959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3508b-1660-44dc-93d9-888e001ce4e8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:23.161434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3508b-1660-44dc-93d9-888e001ce4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:23.161558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3508b-1660-44dc-93d9-888e001ce4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:23.232593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d3a3508b-1660-44dc-93d9-888e001ce4e8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:23.233836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d3a3508b-1660-44dc-93d9-888e001ce4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:23.341322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 729/1477] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:23.659476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:23.661032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:23.799533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c53f64-b04e-483e-bee9-903e8f10a30e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:23.852593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:23.901633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:23.902303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:23.902624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:23.902939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:23.903652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:23.905531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:38:23.905531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:38:23.905531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:38:23.906804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a272662-e162-4df6-8196-a41f047fd9aa admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:23.926825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 749/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:23 2022] GET /identity/v3/projects => generated 2553 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:38:25.927758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:25.928284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:25.928284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:25.929742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 730/1479] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:25.934978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5d3-93a6-410b-a105-ffb24fbd92f0 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:25.935417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5d3-93a6-410b-a105-ffb24fbd92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:25.935518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeca5d3-93a6-410b-a105-ffb24fbd92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:26.004345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bbeca5d3-93a6-410b-a105-ffb24fbd92f0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:26.005576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bbeca5d3-93a6-410b-a105-ffb24fbd92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:26.109887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 750/1480] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:26.414472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:26.416101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:26.426178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:26.573333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339683c2-7afd-46f4-b1bf-137664119cce None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:26.654634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:26.687671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:26.688307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:26.688588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:26.688981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:26.690606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:26.781711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:26.783324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd24633-b30b-4073-93df-23c33ed091ab service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:26.802873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 731/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:28.925265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:28.925852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:28.925852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:28.927146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 751/1482] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:28.932677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635985-6c05-485d-9331-abff2082812a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:28.933183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635985-6c05-485d-9331-abff2082812a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:28.933327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635985-6c05-485d-9331-abff2082812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:29.000308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c6635985-6c05-485d-9331-abff2082812a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:29.001531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c6635985-6c05-485d-9331-abff2082812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:29.048425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:29.101638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 732/1483] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:29.388871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:29.390592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:29.415390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:29.495941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faba9b0-5ca9-493d-a8a1-c1f7fbb859e1 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:29.570112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:29.570715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:29.570999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:29.571271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:29.572877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:29.646951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:29.689269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:29.690694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308aa346-ed93-4eb7-9e5c-f93abb5a24f6 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:29.708958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 752/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:31.709474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:31.710062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:31.710062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:31.712429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 733/1485] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:31.717535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383475e-f877-46d7-b5bf-8e833144283f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:31.717995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383475e-f877-46d7-b5bf-8e833144283f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:31.718100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383475e-f877-46d7-b5bf-8e833144283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:31.785009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6383475e-f877-46d7-b5bf-8e833144283f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:31.786221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6383475e-f877-46d7-b5bf-8e833144283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:31.884689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 753/1486] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:32.178598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:32.180844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:32.286445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f40ba-eee0-4caa-b974-3094e9fd4eb4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:32.359398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:32.361110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:32.361732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:32.362016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:32.362484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:32.364460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:32.473778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:32.475107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdfa65-5aa7-45a0-8b4d-0f83102f7637 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:32.494798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 734/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:34.565487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:34.566073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:34.566073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:34.567369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 754/1488] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:38:34.573221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97aa4-8e50-4204-b33d-29349f30e3a9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:34.573661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97aa4-8e50-4204-b33d-29349f30e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:34.573770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f97aa4-8e50-4204-b33d-29349f30e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:34.639678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-73f97aa4-8e50-4204-b33d-29349f30e3a9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:34.640914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-73f97aa4-8e50-4204-b33d-29349f30e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:34.695827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:34.740821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 735/1489] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:35.047749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:35.049334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:35.084722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:35.154816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed2e9f-0867-4f7a-b5db-4b4e1364b9b4 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:35.226674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:35.227271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:35.227547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:35.227814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:35.229426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:35.310554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:35.341050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:35.342477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114020df-eeb6-4f76-8ac3-02df9ce1a8ba service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:35.360421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 755/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:37.508519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:37.509069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:37.509069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:37.510349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 736/1491] 10.222.0.70 () {54 vars in 927 bytes} [Wed Aug 31 10:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:37.515777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125183fc-1181-4cc1-93a5-4b722dac4099 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:37.516200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125183fc-1181-4cc1-93a5-4b722dac4099 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:37.516377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125183fc-1181-4cc1-93a5-4b722dac4099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:37.583830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-125183fc-1181-4cc1-93a5-4b722dac4099 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:37.585170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-125183fc-1181-4cc1-93a5-4b722dac4099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:37.681451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 756/1492] 10.222.0.70 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:38:37.971571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:37.973130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:38.085821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ad81c-bb84-4b19-9ead-efdbe05a7acb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:38.158697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:38.159292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:38.159566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:38.159834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:38.161443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:38.171359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:38.271473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:38.273816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5caf2e3-6284-4070-a5f9-04199929ccec service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:38.292321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 737/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:38:47.679684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=82 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:48.290175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=50 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:53.907219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.907771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.907771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.983323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:53.984657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.081821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 757/1494] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:39:54.090493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.091000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.091124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.167156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:54.168376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.262831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 738/1495] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:39:54.267459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.268691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.281016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ebf0d-1287-425a-b000-4bfb37a96b65 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.341231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.377227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.377829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.378110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.378387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.379018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:54.379316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.380310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:54.380310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:39:54.380310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:39:54.382097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.393208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 758/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:54.401896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.410963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94955c33-31e4-466b-a192-96cc9b138710 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.471679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.504596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.505217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.505488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.505824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.507051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.508860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:54.508860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:39:54.508860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:39:54.510066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.567073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 739/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:39:54 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:54.571927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.573490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.605849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa844e-dbc0-48f4-b9d6-f99bbb93eea2 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.700174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.700791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.701065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.701327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.701951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.702992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:54.702992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:39:54.702992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:39:54.704202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.745688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 759/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:39:54 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:54.749778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.751290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.812992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfe539-81f2-4c13-9c4b-6b4d2fc10f8f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.895089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.907829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.908490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.908785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.909060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.909703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.910803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:54.910803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:39:54.910803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:39:54.911698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.924508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 740/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:39:54.928663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.930199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.941430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b472e0-23a4-4093-aa09-f61282c835a0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.967437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.042329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.042931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.043202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.043467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.044095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.045136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:55.045136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:39:55.045136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:39:55.046019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014b17e-a252-4334-acff-eaa76fe7b929 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.058804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 760/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:39:55.063041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.064573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:55.098227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f7107-0692-4978-bae5-787e17a461aa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.196858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.197451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.197728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.197997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] PATH_INFO: `/v3/projects/3830930205664b5cb68a4c57cfcb2796/users/7e93c627e044455d9c669a37c4c1f239/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.219732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3830930205664b5cb68a4c57cfcb2796, user_id=7e93c627e044455d9c669a37c4c1f239, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.220776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:55.220776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:39:55.220776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:39:55.222731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249c4bd-3e77-4c53-9e24-8694633b40be admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.393185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 741/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:39:55 2022] PUT /identity/v3/projects/3830930205664b5cb68a4c57cfcb2796/users/7e93c627e044455d9c669a37c4c1f239/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:55.405632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ce8f-549e-4814-bfb2-5aaf04929e21 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.406051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ce8f-549e-4814-bfb2-5aaf04929e21 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.406340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3ce8f-549e-4814-bfb2-5aaf04929e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.464455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e5d3ce8f-549e-4814-bfb2-5aaf04929e21 None None] MFA Rules not processed for user `7e93c627e044455d9c669a37c4c1f239`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:55.465611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e5d3ce8f-549e-4814-bfb2-5aaf04929e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:55.542804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 761/1502] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:39:55.556573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.556885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.557159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.558511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 742/1503] 10.222.0.70 () {54 vars in 964 bytes} [Wed Aug 31 10:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:55.563148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095366b-1ac9-4b5a-bd50-ff9484a2f6db None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.563437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095366b-1ac9-4b5a-bd50-ff9484a2f6db None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.563712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095366b-1ac9-4b5a-bd50-ff9484a2f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.594323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.639954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f095366b-1ac9-4b5a-bd50-ff9484a2f6db None None] MFA Rules not processed for user `252058d963a641a68e526a016ff50031`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:55.641200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f095366b-1ac9-4b5a-bd50-ff9484a2f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:55.715579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 762/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Wed Aug 31 10:39:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:39:55.725873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.727369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:55.776873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.831857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4212d-7ac4-4723-8ae3-60481a4dc834 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.904640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.905260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.905532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.905797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.907371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:56.003098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.004458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.008129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.024719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 743/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:39:56.070304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dab65-a2a9-4c05-bfa2-0ec8cca9c8be None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.070734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dab65-a2a9-4c05-bfa2-0ec8cca9c8be None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.070860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dab65-a2a9-4c05-bfa2-0ec8cca9c8be None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.072119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 763/1506] 10.222.0.70 () {52 vars in 830 bytes} [Wed Aug 31 10:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:56.075622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.076858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:56.175406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64053ad-c652-4d5e-a19c-a44906c864b8 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.274681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.275227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.275502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.275772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] PATH_INFO: `/v3/users/7e93c627e044455d9c669a37c4c1f239` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.289218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e93c627e044455d9c669a37c4c1f239)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.290235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:56.290235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:39:56.290235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:39:56.291447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.301032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.356364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e93c627e044455d9c669a37c4c1f239'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:56.368852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e93c627e044455d9c669a37c4c1f239'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:56.369319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e93c627e044455d9c669a37c4c1f239'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:56.370510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e93c627e044455d9c669a37c4c1f239'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:56.395922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e93c627e044455d9c669a37c4c1f239'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:56.415692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 744/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:39:56 2022] DELETE /identity/v3/users/7e93c627e044455d9c669a37c4c1f239 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:56.420079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.420364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.420637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.477780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:56.478984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:56.558239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.571287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 764/1508] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:39:56.580734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.582023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:56.680960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab809c9-7006-4163-b243-1446af5a35f6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.735661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.756839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.757457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.757739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.758009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.759608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:56.868690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.870148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb031a8-f69a-4211-857e-8ed859f027e2 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.888248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 745/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:39:57.218063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:57.219306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:57.230869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a89dce-c9a4-460b-b046-fff2be29e504 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:57.331520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:57.332147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:57.332420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:57.332686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] PATH_INFO: `/v3/projects/3830930205664b5cb68a4c57cfcb2796` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:57.342675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3830930205664b5cb68a4c57cfcb2796)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:57.343703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:39:57.343703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:39:57.343703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:39:57.344923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:57.401945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3830930205664b5cb68a4c57cfcb2796', 'request_id': 'req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:57.416707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3830930205664b5cb68a4c57cfcb2796', 'request_id': 'req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:57.425926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3830930205664b5cb68a4c57cfcb2796', 'request_id': 'req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:57.449729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] The token cache is being invalidate because project 3830930205664b5cb68a4c57cfcb2796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:39:57.450019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:57.450442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-da6ae8bc-a807-4d7c-afa4-7513da8cdb52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:39:57.451829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 765/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:39:57 2022] DELETE /identity/v3/projects/3830930205664b5cb68a4c57cfcb2796 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:06.885901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=62 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.447845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.211866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.212466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.212466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.213927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:39.219832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5ee5f-7394-4698-b3ed-f1eea4a6a8fb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.220318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5ee5f-7394-4698-b3ed-f1eea4a6a8fb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.220424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5ee5f-7394-4698-b3ed-f1eea4a6a8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.319729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-eef5ee5f-7394-4698-b3ed-f1eea4a6a8fb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:39.321090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eef5ee5f-7394-4698-b3ed-f1eea4a6a8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:39.443385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:39.604170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.606329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:39.737241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efdf7b-96fb-465c-8ea0-48fbb43479b5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.743280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.743885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.744162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.744442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.754589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.756185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c702693-1dbe-436a-84ba-d495fe24cb90 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.767372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 747/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:41:40.665222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e55f7-4a7e-4806-a788-f0479fbdbb53 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.665802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e55f7-4a7e-4806-a788-f0479fbdbb53 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.665802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e55f7-4a7e-4806-a788-f0479fbdbb53 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.667113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:40.672108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce62aa-4f4f-4276-a006-51d83f85d1f3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.672543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce62aa-4f4f-4276-a006-51d83f85d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.672649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce62aa-4f4f-4276-a006-51d83f85d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.693848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f3ce62aa-4f4f-4276-a006-51d83f85d1f3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:40.695829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f3ce62aa-4f4f-4276-a006-51d83f85d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:40.704104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:40.756413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0298b-21c1-44c7-aefe-cea890a5004d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.757279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0298b-21c1-44c7-aefe-cea890a5004d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.757279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0298b-21c1-44c7-aefe-cea890a5004d None None] PATH_INFO: `/v3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.758951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 768/1516] 10.222.0.77 () {54 vars in 925 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:40.765391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807706ab-ee3f-4909-94be-e9306d97ba61 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.765668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807706ab-ee3f-4909-94be-e9306d97ba61 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.765933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807706ab-ee3f-4909-94be-e9306d97ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.834056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-807706ab-ee3f-4909-94be-e9306d97ba61 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:40.836313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-807706ab-ee3f-4909-94be-e9306d97ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:40.870286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0298b-21c1-44c7-aefe-cea890a5004d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:40.884316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0298b-21c1-44c7-aefe-cea890a5004d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:40.890328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:40.890931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:40.891207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:40.891476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:40.896460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:40.902019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:40.903697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0252b-0a2f-4bad-b0a2-1d7131fbd9d0 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:40.917568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 769/1517] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:41:40.926464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 749/1518] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 31 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:49.907546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc330-a7a7-4d64-9a33-1a5977675b5d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.908052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc330-a7a7-4d64-9a33-1a5977675b5d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.908052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bc330-a7a7-4d64-9a33-1a5977675b5d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.909368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 770/1519] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 31 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:49.914804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66d1-a5b5-4a87-ac46-4ee71665de4c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.915235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66d1-a5b5-4a87-ac46-4ee71665de4c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.915341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b66d1-a5b5-4a87-ac46-4ee71665de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.934677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ba8b66d1-a5b5-4a87-ac46-4ee71665de4c None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:49.935873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ba8b66d1-a5b5-4a87-ac46-4ee71665de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:49.944864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 750/1520] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 31 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:49.952097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc330-a7a7-4d64-9a33-1a5977675b5d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:49.965531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bc330-a7a7-4d64-9a33-1a5977675b5d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:49.970287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:49.970861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:49.971130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:49.971396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:49.979245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:49.980817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208086dd-22b6-4edf-98ca-ba45a10c6158 service placement] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:49.990144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 771/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:41:52.169896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc656ee-e933-47dd-91f3-b2186fe4ef73 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.170485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc656ee-e933-47dd-91f3-b2186fe4ef73 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.170485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc656ee-e933-47dd-91f3-b2186fe4ef73 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.171796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:52.176511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898e2f-9ca1-44e5-9348-3106841de8d3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.176976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898e2f-9ca1-44e5-9348-3106841de8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.177089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898e2f-9ca1-44e5-9348-3106841de8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.196653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-73898e2f-9ca1-44e5-9348-3106841de8d3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:52.197864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-73898e2f-9ca1-44e5-9348-3106841de8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:52.205701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:52.359478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc656ee-e933-47dd-91f3-b2186fe4ef73 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:52.374970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc656ee-e933-47dd-91f3-b2186fe4ef73 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:52.380340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:52.380961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:52.381281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:52.382097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:52.390465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:52.392051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130f0f3-7c7b-48a1-a9f1-deac472b19cd service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:52.401915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 752/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:41:53.223070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b17a-f416-45b3-af84-f3ad7e5a417d None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.223597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b17a-f416-45b3-af84-f3ad7e5a417d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.223597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373b17a-f416-45b3-af84-f3ad7e5a417d None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.225336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:53.230268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959ba0-dd21-4021-a839-01e5cbacfcb9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.230726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959ba0-dd21-4021-a839-01e5cbacfcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.230839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40959ba0-dd21-4021-a839-01e5cbacfcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.251006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-40959ba0-dd21-4021-a839-01e5cbacfcb9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:53.252221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-40959ba0-dd21-4021-a839-01e5cbacfcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:53.261037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:53.418899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b17a-f416-45b3-af84-f3ad7e5a417d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.434570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373b17a-f416-45b3-af84-f3ad7e5a417d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.439965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.440567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.440873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.441148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.450611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.452113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d91ce-c6f6-4c54-834c-0cdb93169927 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.462246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 774/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:41:57.606964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.607580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.607580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.608911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:57.616435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbfc5e-5149-4778-a31d-0dc82744fa19 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.617385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbfc5e-5149-4778-a31d-0dc82744fa19 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.617385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbfc5e-5149-4778-a31d-0dc82744fa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.644051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d2cbfc5e-5149-4778-a31d-0dc82744fa19 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:57.645570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d2cbfc5e-5149-4778-a31d-0dc82744fa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:57.654551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:41:57.952468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.954308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:58.055199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc58b2-40fb-41bf-8891-9aaf4752540c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:58.061064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:58.062018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:58.062496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:58.062968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:58.079910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:58.082615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b7c68-e611-41e4-b959-1eb82d0efe30 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:58.099754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 755/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:42:00.038453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb6a3-c6dc-456f-b085-4982dbfbd049 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.038985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb6a3-c6dc-456f-b085-4982dbfbd049 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.038985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fb6a3-c6dc-456f-b085-4982dbfbd049 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.040273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:00.045560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e7759-2052-4b2a-9029-3a0abf541a71 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.045995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e7759-2052-4b2a-9029-3a0abf541a71 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.046101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e7759-2052-4b2a-9029-3a0abf541a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.065525 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ca1e7759-2052-4b2a-9029-3a0abf541a71 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:00.066744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ca1e7759-2052-4b2a-9029-3a0abf541a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:00.075310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:42:00.367110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb6a3-c6dc-456f-b085-4982dbfbd049 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.378495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fb6a3-c6dc-456f-b085-4982dbfbd049 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.382589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.383173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.383471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.383740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.392505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.393941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a924737-c9da-41a5-ad9a-d479ad0481d2 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.404102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 777/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:42:04.192254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.192926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.192926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.194919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:04.200403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ebef-5a04-4583-b49d-5ad2b04cb16d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.200920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ebef-5a04-4583-b49d-5ad2b04cb16d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.201042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ebef-5a04-4583-b49d-5ad2b04cb16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.208605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:04.221520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-3885ebef-5a04-4583-b49d-5ad2b04cb16d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:04.222729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3885ebef-5a04-4583-b49d-5ad2b04cb16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:04.232927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:42:04.802443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:04.804805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:04.892343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ebd6-3ce6-4e58-b2fb-ff232dea2d7e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:04.896251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:04.896973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:04.897210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:04.897484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:04.907322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:04.908989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621f3b7-14f7-4a08-bf8d-379084fb5861 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:04.919560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 758/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:42:07.008291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.008903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.008903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.010209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:07.015928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3268-69fa-4e89-81e8-4f101c0a398f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.016398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3268-69fa-4e89-81e8-4f101c0a398f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.016516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca3268-69fa-4e89-81e8-4f101c0a398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.039166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c1ca3268-69fa-4e89-81e8-4f101c0a398f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:07.040405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c1ca3268-69fa-4e89-81e8-4f101c0a398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:07.048642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:42:07.661558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:07.664503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:07.680877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7bf42-e4c9-4173-ac97-4ed9d64fb324 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:07.686720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:07.687708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:07.688171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:07.688640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:07.703338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:07.705008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502ae5-b308-4f8f-80e4-3b721e4f4e97 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:07.719495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 780/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:42:17.032171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:17.711832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:47.442354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e66-91bf-4e8c-99c8-b917823061fd None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.444915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e66-91bf-4e8c-99c8-b917823061fd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.444915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99095e66-91bf-4e8c-99c8-b917823061fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.474011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-99095e66-91bf-4e8c-99c8-b917823061fd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.475273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-99095e66-91bf-4e8c-99c8-b917823061fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.488829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 760/1540] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.497694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.498269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.498269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.526727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.528389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.540295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 781/1541] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:43:47.545169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:47.547415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487068-fcd3-4d53-ad6d-0a777932845c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.547914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487068-fcd3-4d53-ad6d-0a777932845c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.548383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487068-fcd3-4d53-ad6d-0a777932845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.562290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc61e6d-8918-463a-b0ec-758e45d35225 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:47.573225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:47.574396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.574883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.575359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.576264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:47.576816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:47.578819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:47.589964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2c487068-fcd3-4d53-ad6d-0a777932845c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.596423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2c487068-fcd3-4d53-ad6d-0a777932845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.615879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 782/1542] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:43:47.619474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 761/1543] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.623405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:47.634142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912544d-dc60-428d-8ddb-413309370029 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.634924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912544d-dc60-428d-8ddb-413309370029 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.635455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912544d-dc60-428d-8ddb-413309370029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.652231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a0812-ee6d-4d3f-8779-61865131b7c2 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:47.670553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:47.671691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.672200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.672689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.673594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:47.674866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:47.674866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:43:47.674866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:43:47.677251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5076c-04e3-48ad-8fc4-22949cc00045 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:47.684787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a912544d-dc60-428d-8ddb-413309370029 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.684787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a912544d-dc60-428d-8ddb-413309370029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.704819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 762/1544] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:43:47.706106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7d80-ff71-4e0e-a80d-f301dbd9b112 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.707055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7d80-ff71-4e0e-a80d-f301dbd9b112 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.707910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7d80-ff71-4e0e-a80d-f301dbd9b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.743276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-37db7d80-ff71-4e0e-a80d-f301dbd9b112 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.744504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-37db7d80-ff71-4e0e-a80d-f301dbd9b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.765272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 763/1545] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.768183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 783/1546] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/projects => generated 401 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:43:47.770285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.770569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.771109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.773327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fe8-9589-4a71-924a-004c43d955c2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.773622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fe8-9589-4a71-924a-004c43d955c2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.773901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e76fe8-9589-4a71-924a-004c43d955c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.809837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-88e76fe8-9589-4a71-924a-004c43d955c2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.811084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-88e76fe8-9589-4a71-924a-004c43d955c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.812408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.813739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.885300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 764/1547] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.886575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.886862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.887143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.893954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 784/1548] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.895479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:47.905271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bdea-b837-403d-b27e-77429e6e48ee None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:47.911074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:47.911668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.911941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.912210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.912878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:47.913178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:47.913552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.914777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eea73d-017d-48e9-9002-92cbaaf81688 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:47.914911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.924743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 765/1549] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.926288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:47.930915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 785/1550] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:47.932234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9ccb-0d14-40a9-969e-f68a96df639a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.932518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9ccb-0d14-40a9-969e-f68a96df639a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.932820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9ccb-0d14-40a9-969e-f68a96df639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.936241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3990-9f69-4602-acf1-95e2fd271c5a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:47.940871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:47.941571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.941853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.942129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.942877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:47.943898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:47.943898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:43:47.943898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:43:47.945144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea39279-7fa3-4ef5-8ebe-5a4382d07a6a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:47.953239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-595b9ccb-0d14-40a9-969e-f68a96df639a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.954445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-595b9ccb-0d14-40a9-969e-f68a96df639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.963192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 786/1551] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.964386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b9e5-76f4-4b22-a650-598e1b6422af None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.964667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b9e5-76f4-4b22-a650-598e1b6422af None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.965002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec4b9e5-76f4-4b22-a650-598e1b6422af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.971237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 766/1552] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/users => generated 301 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:47.971237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47256-64f4-4e21-9b2f-ae2eb22ab4e2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.971237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47256-64f4-4e21-9b2f-ae2eb22ab4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.971237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef47256-64f4-4e21-9b2f-ae2eb22ab4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:47.984898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8ec4b9e5-76f4-4b22-a650-598e1b6422af None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.986091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8ec4b9e5-76f4-4b22-a650-598e1b6422af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.991256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1ef47256-64f4-4e21-9b2f-ae2eb22ab4e2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:47.992415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1ef47256-64f4-4e21-9b2f-ae2eb22ab4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:47.995042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 787/1553] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:47.996272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:47.996555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:47.996864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.005040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 767/1554] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.006281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.006564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.006836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.017953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.020239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.028960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 788/1555] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.029820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.030625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.031820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.040389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bae52b-d57a-4a40-8f8f-412ee2a9fb6c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.043465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 768/1556] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.044698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.045557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.046166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.046445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.046713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.047535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.047829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.049446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1069-2285-4175-a0f9-5426fab71b05 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.056962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac70048-8faa-432a-8c4a-b1b24168418e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.061711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.062357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.062635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.062755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 789/1557] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.063094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.063743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.063951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f141e-1e16-492c-902f-7bc6f46990b7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.064229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f141e-1e16-492c-902f-7bc6f46990b7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.064503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f141e-1e16-492c-902f-7bc6f46990b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.065799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.085813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-138f141e-1e16-492c-902f-7bc6f46990b7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.087157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-138f141e-1e16-492c-902f-7bc6f46990b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.093482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 769/1558] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.094494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.099440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 790/1559] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.099440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.099440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.099440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.118883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.120489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.163806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb662db-98b5-4b1a-a8c3-bafaa0a2da5f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.168902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.169508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.169791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.170067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.170716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.172376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643198e-5dbf-484d-a547-275e5cb6092a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.173155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.184674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 770/1560] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:48.188567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 791/1561] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.188567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.188822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.188822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.188822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.197217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705a84-04e3-40ff-ac0e-2eb72b52f316 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.201898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.202496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.202863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.203052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.203700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.204008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.205650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.207520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.208784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.217008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 771/1562] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:48.217788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.218380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 792/1563] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.219033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.230034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba74a24-f586-4a44-a62f-4ac63fa587ed admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.231824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.234765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.235366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.235640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.235912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.236006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb0680-2d2a-4e0c-9195-a7359f2e58df None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.236547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.239688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.242181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.242781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.243072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.243318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.243961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.244261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.245313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:48.245313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:43:48.245313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:43:48.246191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.258278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 772/1564] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.259230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.269761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0c918-9a18-447e-a313-1943a155afc2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.274650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.274812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 793/1565] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.275247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.275530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.275654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.275797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.276421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.278599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.301582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 773/1566] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.302483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.312273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697d65-0d09-443f-9589-2de28db54b64 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.342260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11c7c3-233d-45e7-ad3f-00cec61795ed admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.347109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.347791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.348061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.348332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.349032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.349335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.350943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.364797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 794/1567] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.365925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.372158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.372831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.373647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.373926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.374575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.376250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.376553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009372-e6be-48f8-b2d2-ed9cce928976 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.382102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.382691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.382965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.383234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.383894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.384192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.385791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.387368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 774/1568] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:48.388371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.400078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e72ca-771d-40a4-a1b7-e5a7211cd8cb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.407626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 795/1569] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.407626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.407854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.407854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.407854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.407854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.408272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:48.408272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.409088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.411965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939155b-8884-4b57-9427-bd0c818a1d1a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.416742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.417370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.417647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.417917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.418543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.420422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.421477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 775/1570] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:48.422340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.437997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141bd3-c630-4a77-b4aa-6eb605727067 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.443867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.444549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.444738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.445033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.445656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.447559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.449904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 796/1571] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.450583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.480744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 776/1572] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.480744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.519173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adc456-9a3e-49c5-a41a-71236d160a26 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.541123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040063d-10c2-4ea0-8bfd-6fccf248cc5e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.545663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.545874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.546264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.546538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.546806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.547470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.549199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.559911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 777/1573] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:48.560704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.570990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd76d2-216c-4eeb-99ab-e81b34c9b24f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.575579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.576169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.576451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.576724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.577382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.579401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.581074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.581749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.582017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.582287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.582916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.584961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.611108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 778/1574] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.611307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 797/1575] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.611435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.611530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.620302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e224-0068-48ae-a13b-75beea6dc566 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.621300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.676078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da226d8-fc85-4b47-993b-54e126c04ae9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.676570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.677315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.677686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.678075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.678800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.680698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.680837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.681409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.681687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.681960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] PATH_INFO: `/v3/projects/c088ebc5e9ea4b54b5218d0f6bca3722/users/5abca67fb0074b5a915f61957470501d/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.697175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c088ebc5e9ea4b54b5218d0f6bca3722, user_id=5abca67fb0074b5a915f61957470501d, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.700623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.710206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 798/1576] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.711084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.717158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 779/1577] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:48 2022] PUT /identity/v3/projects/c088ebc5e9ea4b54b5218d0f6bca3722/users/5abca67fb0074b5a915f61957470501d/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:48.717943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.780136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662477f-7223-4653-8481-ce3dc57d9cf4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.786430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0270102-0cb2-44d0-b845-fb45b87630ce admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.787537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.787537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.788356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.788356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.788730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.790679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.794510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.795131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.795414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.795688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.796328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.798312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.823704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 799/1579] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.823914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 780/1579] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.824030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.824453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.834925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f86e4-f5bf-4d8b-9a0c-1a7930308edc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.852691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.885729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b599b-db24-451a-b908-2e320c444472 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.890754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.890925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.891384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.891508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.891662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.891769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.891923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.892031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.892546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.892656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.894882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.895101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.905163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 781/1580] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:48.906306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.918136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602bc21-4319-405d-942b-93494bf8fde2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.920580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 800/1581] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.920580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.923812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.923812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.923812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.924121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.924634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.926556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.933123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9cfe9-fabb-4a91-8d36-cc5bdac8b01d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.937914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.938525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.938754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.939029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.939656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.942072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 782/1582] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:48.942301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbed3b-a5ac-4c81-ad99-23fe193fe9a3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.942795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.952512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd15907-8fa2-40da-a879-1ceec1acb81d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:48.958751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:48.959618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.959895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.960169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.960806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:48.962994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:48.968818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 801/1583] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.970259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:48.970579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:48.970906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:48.972032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.986698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 783/1584] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.988106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:48.991944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:48.993189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:48.998165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0a25a-a12f-4958-bc1d-32a5dfec21cb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.000974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 802/1585] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:49.005127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.005240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.005240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.005240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.005240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.006136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.007672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.012323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58706-c462-4453-bb37-0dae5e5bfc71 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.017061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.017661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.017941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.018211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.018650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 784/1586] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.019979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.021315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.023424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.029775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd83119-b7b5-49a5-9f43-d9641244536c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.034716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.035459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.035690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.036037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] PATH_INFO: `/v3/projects/a0d1426bbd1a40e0bd11014d34476324/users/badb3837c71e4274b1868a3d0d2dfa82/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.046666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 803/1587] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:49 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:49.047496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.056928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d1426bbd1a40e0bd11014d34476324, user_id=badb3837c71e4274b1868a3d0d2dfa82, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.057472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb481585-cf75-42ce-a9bd-1ada4acbc46c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.059753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.062016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.062600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.062874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.063141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.063761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.065357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.073204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 785/1588] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/a0d1426bbd1a40e0bd11014d34476324/users/badb3837c71e4274b1868a3d0d2dfa82/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.077088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.077215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 804/1589] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.079166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.089000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287184-f0e5-4ab4-bd4c-3fd0766e337b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.136834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd9f1e-0e58-46ad-b734-8420eeb9eb90 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.141490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.142088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.142360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.142639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.143256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.145041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.145421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.145918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.146195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.146480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.147108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.148689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.155549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 786/1590] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.158929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.165184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 805/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.165184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.169358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363b5bc-b9e5-4b8f-9ddf-de8ddfa41abe admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.174039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.174626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.174899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.175712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.176432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.178072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.191022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 787/1592] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.191022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.198475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb577a-84a9-4133-b0b4-66b3b7708d37 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.203807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.204395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.204671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.204972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.205596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.209480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.218069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 788/1593] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.218876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.227002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90f5a-d868-4340-bd6f-8efd80318a08 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.228728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecf2a8-922b-4ef4-af6e-f4ed7d8e00c0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.230713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.231323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.231602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.231875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.233257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.233823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.234099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.234362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.234976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.236549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff3849-b3b4-4536-be85-890ef4e7b575 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.241072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.242496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.246934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 789/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.250160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.250160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.250160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.252741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 806/1595] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:49.253854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.260024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:49.264489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6864aae-8b07-426a-bad6-7a8927085e95 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.267830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:49.269714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:49.273535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.274144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.274636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.275342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.275646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.277318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.278151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 790/1596] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:49.278722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.290588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5412-a1f6-43de-92ca-82f1a2f3ec74 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.291054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 807/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.291705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.298395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.299113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.299423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.300430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] PATH_INFO: `/v3/projects/d6c4a09e68874e1d96096345d0d8b65f/users/0639368c7c8f4c6a835a776272840004/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.304861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1b0f5-275a-41ac-a1ae-dea30fc5df68 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.309910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.310517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.310795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.311064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.311727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.313361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.315910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4a09e68874e1d96096345d0d8b65f, user_id=0639368c7c8f4c6a835a776272840004, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.319503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.324679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 808/1598] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.325866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.336905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 791/1599] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/d6c4a09e68874e1d96096345d0d8b65f/users/0639368c7c8f4c6a835a776272840004/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.337319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a6d6f-f2fb-461a-8e09-3c812377e89c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.337730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.406291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:49.410379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.410993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.411273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.411547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.412416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.413872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.425718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0036-518f-4b10-84d3-1fc2764083db admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.429394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 809/1600] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.429394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.431919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.432694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.433315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.433601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] PATH_INFO: `/v3/projects/5674689db71e4d8292aadfea378d91f3/users/476c96600c524cc293bc0e0a65ee8cb5/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.437837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7663-20ed-41f2-9a5b-fa7f6d05a995 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.443687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.444553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.444928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.445365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.446080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.447873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.453006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5674689db71e4d8292aadfea378d91f3, user_id=476c96600c524cc293bc0e0a65ee8cb5, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.456205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.466816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 810/1601] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:49.466816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.470365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:49.480818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 792/1602] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/5674689db71e4d8292aadfea378d91f3/users/476c96600c524cc293bc0e0a65ee8cb5/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.480818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.539112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcf94-9d62-4233-a634-66f5d2d1d731 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.553711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fefc2-2062-419d-a974-1f7fdfecd1f3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.558858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.559512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.559789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.560063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] PATH_INFO: `/v3/projects/d6cef612493046db82d69042d0f70075/users/6c3cd2a49e194a47a366c7669b004209/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.579285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cef612493046db82d69042d0f70075, user_id=6c3cd2a49e194a47a366c7669b004209, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.582130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.600651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.601323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.601673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.602016 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.604939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 793/1603] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/d6cef612493046db82d69042d0f70075/users/6c3cd2a49e194a47a366c7669b004209/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.606358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.617074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.618589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cbeaa-5563-43cb-9299-9904074725e8 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.633593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 811/1604] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:49.635286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.635636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.636060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.658060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:49.660024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:49.686468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:49.712408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2044-cd5b-4fe0-a492-645f7d833429 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.719911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.721021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.721161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.721403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] PATH_INFO: `/v3/projects/e1aa91bfc5de4d06b98fef2fc79fb329/users/972c172ec4ba438180ad77dc9b6e6917/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.735639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 812/1605] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:49.736438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.744293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1aa91bfc5de4d06b98fef2fc79fb329, user_id=972c172ec4ba438180ad77dc9b6e6917, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.747292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.747554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e31b01-0aed-426f-9580-388cca7747a2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.752958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.753805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.754203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.754694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] PATH_INFO: `/v3/projects/261b567d699b427ca7985d6467ec6e71/users/6eea998fa82245aeb938501a16bd94a2/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.766053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 794/1606] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/e1aa91bfc5de4d06b98fef2fc79fb329/users/972c172ec4ba438180ad77dc9b6e6917/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.766721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:49.774575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261b567d699b427ca7985d6467ec6e71, user_id=6eea998fa82245aeb938501a16bd94a2, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.775668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:49.775668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:43:49.775668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:43:49.777652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724910e-e4b8-4676-bdd3-757d25ddd567 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.794259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 813/1607] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/261b567d699b427ca7985d6467ec6e71/users/6eea998fa82245aeb938501a16bd94a2/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.798354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009edca-fd42-457e-baea-ccfb80e3f6c7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.798925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009edca-fd42-457e-baea-ccfb80e3f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.803866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009edca-fd42-457e-baea-ccfb80e3f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.822013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:49.829791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f009edca-fd42-457e-baea-ccfb80e3f6c7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:49.831053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f009edca-fd42-457e-baea-ccfb80e3f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:49.850980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206bc29-9eee-4ad5-8a09-73f751b6641c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:49.910619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 814/1608] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:49.912028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240015-79ef-48a9-ba2c-1f50d94b78a8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.912419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240015-79ef-48a9-ba2c-1f50d94b78a8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.912816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1240015-79ef-48a9-ba2c-1f50d94b78a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.931322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:49.931998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:49.932273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:49.932543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] PATH_INFO: `/v3/projects/c32481e5466241338c93569dec7ad0bf/users/9cd5a46657f641e7b0db8684963c0246/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:49.945990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c1240015-79ef-48a9-ba2c-1f50d94b78a8 None None] MFA Rules not processed for user `6c3cd2a49e194a47a366c7669b004209`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:49.947789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c1240015-79ef-48a9-ba2c-1f50d94b78a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:49.952227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32481e5466241338c93569dec7ad0bf, user_id=9cd5a46657f641e7b0db8684963c0246, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:49.955843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:49.971276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 795/1609] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:49 2022] PUT /identity/v3/projects/c32481e5466241338c93569dec7ad0bf/users/9cd5a46657f641e7b0db8684963c0246/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:49.976701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.028888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 815/1610] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.031222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa3838-c0ca-4a58-9c5a-8842d76cc136 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.031482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa3838-c0ca-4a58-9c5a-8842d76cc136 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.031811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa3838-c0ca-4a58-9c5a-8842d76cc136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.058402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837c4be-b0d0-47bf-a4cf-e78fc57a02d3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.063090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.064096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.064223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-58aa3838-c0ca-4a58-9c5a-8842d76cc136 None None] MFA Rules not processed for user `972c172ec4ba438180ad77dc9b6e6917`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:50.064345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.064470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.065698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-58aa3838-c0ca-4a58-9c5a-8842d76cc136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:50.090254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:50.140285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.141766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.145106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 816/1611] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.146956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156ebf-d0b5-48d9-8ab9-63a47001f203 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.147493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156ebf-d0b5-48d9-8ab9-63a47001f203 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.147493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156ebf-d0b5-48d9-8ab9-63a47001f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.171835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 796/1612] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:50.173230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.186433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c67c-5088-4525-a831-f486a1e95475 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.193924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.194837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.195255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.195742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.196750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9f156ebf-d0b5-48d9-8ab9-63a47001f203 None None] MFA Rules not processed for user `6eea998fa82245aeb938501a16bd94a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:50.198095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9f156ebf-d0b5-48d9-8ab9-63a47001f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:50.210096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.212794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3565c7-f679-463c-833f-50c1c93bb7d7 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.228527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 797/1613] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:50.229893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e704204-757b-4859-99a0-38b622cab61c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.230317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e704204-757b-4859-99a0-38b622cab61c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.230931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e704204-757b-4859-99a0-38b622cab61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.244680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:50.272258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3e704204-757b-4859-99a0-38b622cab61c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:50.273622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3e704204-757b-4859-99a0-38b622cab61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:50.293726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 798/1614] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.294782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e704204-757b-4859-99a0-38b622cab61c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.318216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e704204-757b-4859-99a0-38b622cab61c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.323357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 817/1615] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.324429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651e3e-e1ea-46e8-874f-4b2cbc513dd9 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.324708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651e3e-e1ea-46e8-874f-4b2cbc513dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.325017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5651e3e-e1ea-46e8-874f-4b2cbc513dd9 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.340801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 818/1616] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 31 10:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:50.340801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651e3e-e1ea-46e8-874f-4b2cbc513dd9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.341221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.341425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5651e3e-e1ea-46e8-874f-4b2cbc513dd9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.341601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.342335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.343066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.347965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.348240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.348429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.348429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.348429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.351357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.358407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.360041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe109c-dd4c-4507-955b-253b3a0f4c40 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.374301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 819/1617] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:50.375436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963465e5-6df8-4a1a-a4f9-dcd5785e6af9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.375722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963465e5-6df8-4a1a-a4f9-dcd5785e6af9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.376117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963465e5-6df8-4a1a-a4f9-dcd5785e6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.431555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 799/1618] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:50.432832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.439598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-963465e5-6df8-4a1a-a4f9-dcd5785e6af9 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:50.441238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-963465e5-6df8-4a1a-a4f9-dcd5785e6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:50.600590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 820/1619] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.602034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.602343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.602727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.636505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fc138-61cc-4c4b-9055-385a582ca3f0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.653761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.654927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.655530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.656633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.662524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.677623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.679447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] MFA Rules not processed for user `5abca67fb0074b5a915f61957470501d`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:50.680886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:50.688637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:50.748299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 800/1620] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:50.750000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.824885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 821/1621] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:50.824885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.842117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ac57f-f943-41ae-8433-f959068027ca admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.847828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8fc5a-3531-4ca5-9f2e-add7e2362148 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.849848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.851149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.851712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.853056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.853870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.856130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.891919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 801/1622] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/users => generated 309 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:50.893119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.910696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e121e8-5d61-4d59-af33-fc15944ed9bf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.926128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.927181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.927553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.928087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.929365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:50.931632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:50.970897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 802/1623] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/users => generated 295 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:50.972365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:50.985798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4202-6d04-4750-bc1a-a72849dc4c4e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:50.997315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:50.997978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:50.998365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:50.998570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:50.999381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.005687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.026480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.027304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.027583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.027851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.069258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 803/1624] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:43:50 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:51.070729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.097288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:51.115686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.117324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.140833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 822/1625] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:51.142044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.163496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4b839-5f93-4734-8f71-565c8ebeb154 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.201997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830f01e-35ec-4e76-8d08-dbf6a21ed898 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.210419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.211445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.212128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.212620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.213512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.216007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.235011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 804/1626] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.236212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.255493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec76ee4-c516-4cb9-b002-dba5f8031951 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.265201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.266223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.267300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.268550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.270528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:51.271802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.274657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.309902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.310296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.312144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.312425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.313537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.316948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.320898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 805/1627] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:51 2022] POST /identity/v3/users => generated 309 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:51.324540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.329203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 823/1628] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.330381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.351702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697c83-405e-4f4b-9520-16eeccf84ae3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.354749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b0bd1-d5c2-41f3-bb1e-78939944dbee admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.362709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.363330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.363614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.363894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] PATH_INFO: `/v3/projects/333489239bcd4a7c977119d29289c07d/users/45a9a56a792c4ca1b076ec00799ceddc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.377086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.381978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.382475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.382922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.383854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.388903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.401268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333489239bcd4a7c977119d29289c07d, user_id=45a9a56a792c4ca1b076ec00799ceddc, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.404086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.405978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 824/1629] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.407718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.422732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f8bc-abc2-42e2-9e03-c702300d7a09 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.432148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.433107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.436385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 806/1630] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:51 2022] PUT /identity/v3/projects/333489239bcd4a7c977119d29289c07d/users/45a9a56a792c4ca1b076ec00799ceddc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:51.436385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.437581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.437954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] PATH_INFO: `/v3/projects/8d99cec5b1674d5a9d6b512e597b6285/users/8915595efbc1416e8457afbbff79b638/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.468037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d99cec5b1674d5a9d6b512e597b6285, user_id=8915595efbc1416e8457afbbff79b638, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.472687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.511088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a85a-ea3d-4bca-aa19-ac72e34d5188 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.512037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 825/1631] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:51 2022] PUT /identity/v3/projects/8d99cec5b1674d5a9d6b512e597b6285/users/8915595efbc1416e8457afbbff79b638/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:51.513586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.588445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.589335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.589530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.589786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] PATH_INFO: `/v3/projects/49be235dad324e79b3e05a8e7ccec10f/users/b8e1cea283344d66b2949312b674aa09/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.602030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bfccfd-43e6-48bc-9968-390bd9bc5389 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.607998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.608580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.608884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.609159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.614167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.615967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.623784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49be235dad324e79b3e05a8e7ccec10f, user_id=b8e1cea283344d66b2949312b674aa09, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.626727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7f980-bde6-460f-90aa-09fefbb1f897 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.630021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:51.631485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 826/1632] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.632450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.647039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81f87-2fc2-4ee9-8816-1ffdc89167d7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.655857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.656533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.656853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.657129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.658061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.658178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 807/1633] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:51 2022] PUT /identity/v3/projects/49be235dad324e79b3e05a8e7ccec10f/users/b8e1cea283344d66b2949312b674aa09/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:51.660666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.663009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f0b6-4c5f-4a6c-8e5a-010b6b465a9b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.663293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f0b6-4c5f-4a6c-8e5a-010b6b465a9b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.663573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7f0b6-4c5f-4a6c-8e5a-010b6b465a9b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.664920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 808/1634] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 31 10:43:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:51.665624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7f0b6-4c5f-4a6c-8e5a-010b6b465a9b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.678321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 827/1635] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.680188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.711450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3c41d-df7e-4c37-a80a-b0af0eb0076b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.828860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7f0b6-4c5f-4a6c-8e5a-010b6b465a9b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:51.839683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.840735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.841238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.841663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:51.841925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] PATH_INFO: `/v3/projects/333489239bcd4a7c977119d29289c07d/users/45a9a56a792c4ca1b076ec00799ceddc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.842448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.842730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.843008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.843721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.845822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679e6bd-eb28-4f8a-9b8d-ee697e94b825 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.846160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] RBAC: Authorizing `identity:create_grant(project_id=333489239bcd4a7c977119d29289c07d, user_id=45a9a56a792c4ca1b076ec00799ceddc, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:51.849666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:51.864116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 828/1636] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:51.866868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d1f4-6a97-4d66-9491-3fc8bea7b43d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:51.867167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d1f4-6a97-4d66-9491-3fc8bea7b43d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:51.867734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432d1f4-6a97-4d66-9491-3fc8bea7b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:51.880661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 809/1637] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:51 2022] PUT /identity/v3/projects/333489239bcd4a7c977119d29289c07d/users/45a9a56a792c4ca1b076ec00799ceddc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:51.889538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:51.923764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d432d1f4-6a97-4d66-9491-3fc8bea7b43d None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:51.925874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d432d1f4-6a97-4d66-9491-3fc8bea7b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:51.975084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:51.992222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eff27-da36-4d16-b95f-d8f3d733444e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:52.014294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:52.014990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.015271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.015546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] PATH_INFO: `/v3/projects/8d99cec5b1674d5a9d6b512e597b6285/users/8915595efbc1416e8457afbbff79b638/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.019014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d99cec5b1674d5a9d6b512e597b6285, user_id=8915595efbc1416e8457afbbff79b638, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:52.026688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:52.041768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 810/1638] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:51 2022] PUT /identity/v3/projects/8d99cec5b1674d5a9d6b512e597b6285/users/8915595efbc1416e8457afbbff79b638/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:52.042611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:52.105375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 829/1639] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:52.110458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.110830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.111341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.150982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6051c0f-d498-4031-a9da-1aefb7e59f15 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:52.156043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] MFA Rules not processed for user `45a9a56a792c4ca1b076ec00799ceddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:52.159026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:52.160747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:52.162091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.162623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.163414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] PATH_INFO: `/v3/projects/49be235dad324e79b3e05a8e7ccec10f/users/b8e1cea283344d66b2949312b674aa09/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.169252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49be235dad324e79b3e05a8e7ccec10f, user_id=b8e1cea283344d66b2949312b674aa09, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:52.178472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84101f83-b9e9-4845-8ddd-5b2053b7eacb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:52.207282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 811/1640] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:43:52 2022] PUT /identity/v3/projects/49be235dad324e79b3e05a8e7ccec10f/users/b8e1cea283344d66b2949312b674aa09/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:52.207490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.207794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.208215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.246126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] MFA Rules not processed for user `8915595efbc1416e8457afbbff79b638`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:52.247599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:52.256805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:52.326260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 830/1641] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:52.338902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:52.391417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 812/1642] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:52.394631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:52.467240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af929011-f4ea-4b5e-ab06-f183c0145bdd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:52.487269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8f3d2-0c89-4fb4-895e-57ef59cdca03 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:52.493006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:52.494017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.494303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.494643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.554251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:52.555169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.556203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.556640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.576578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:52.585607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:52.587121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:52.601904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 813/1643] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:52.680804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:52.682344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:52.711659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 831/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:52.747458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:52.767011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37f9f0-9f44-4a8f-a7b3-2f025e40f50f service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:52.781105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:52.781736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:52.782009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:52.782275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:52.895064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:52.919939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:52.921068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4502dd-6c5f-443f-970b-86b00afb50f7 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:52.945093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 814/1645] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:53.965670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:54.091050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7053b3-c0c9-4b1e-a315-e3d4a4e3c38d None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.091593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7053b3-c0c9-4b1e-a315-e3d4a4e3c38d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.091593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7053b3-c0c9-4b1e-a315-e3d4a4e3c38d None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.093448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 815/1646] 10.222.0.70 () {54 vars in 962 bytes} [Wed Aug 31 10:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:54.109354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6147-a73f-46cb-a792-15b50ea25f0f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.109354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6147-a73f-46cb-a792-15b50ea25f0f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.109354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d6147-a73f-46cb-a792-15b50ea25f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.146919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-af7d6147-a73f-46cb-a792-15b50ea25f0f None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:54.150015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-af7d6147-a73f-46cb-a792-15b50ea25f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:54.172638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 816/1647] 10.222.0.70 () {58 vars in 1059 bytes} [Wed Aug 31 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:43:54.174840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca514dd9-1461-4102-895f-5154eea6d2ce None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.175625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca514dd9-1461-4102-895f-5154eea6d2ce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.176100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca514dd9-1461-4102-895f-5154eea6d2ce None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.177623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 817/1648] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 31 10:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:54.182655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.183033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.183212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.187761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0224-bb5c-4815-94eb-35d341638f8d service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:54.196120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:54.197320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.197820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.199262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] PATH_INFO: `/v3/users/6c3cd2a49e194a47a366c7669b004209` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.201263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3cd2a49e194a47a366c7669b004209)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:54.203088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: WARNING py.warnings [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:54.203088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: warnings.warn(msg) Aug 31 10:43:54.203088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: Aug 31 10:43:54.204829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:54.207402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:54.208437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:54.225409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 818/1649] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:54.234076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:54.244846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b72229-c1e4-45c9-b320-ecbffe5de48a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:54.251089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:54.251874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.252444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.252919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.269488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:54.272264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf4afe-05d5-4aee-b234-ec92087b7af7 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:54.301094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 819/1650] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:54.314574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3cd2a49e194a47a366c7669b004209'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:54.317899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3cd2a49e194a47a366c7669b004209'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:54.337032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3cd2a49e194a47a366c7669b004209'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:54.396274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3cd2a49e194a47a366c7669b004209'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:54.435721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3cd2a49e194a47a366c7669b004209'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:54.461772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456a67-eb66-4132-af09-ed49e2265b27 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.462113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456a67-eb66-4132-af09-ed49e2265b27 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.462484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec456a67-eb66-4132-af09-ed49e2265b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.463558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 832/1651] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:43:53 2022] DELETE /identity/v3/users/6c3cd2a49e194a47a366c7669b004209 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:54.502230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ec456a67-eb66-4132-af09-ed49e2265b27 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:54.506175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec456a67-eb66-4132-af09-ed49e2265b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:54.644671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 820/1652] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:43:54.710500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:54.714531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:54.788034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:54.888430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed90924-1dad-4a1e-ab85-72e715e9f95e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:54.888430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:54.888430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:54.888430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:54.889026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:54.900355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:54.902723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:54.915909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 833/1653] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:55.016994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:55.017393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:55.017743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:55.076047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] MFA Rules not processed for user `b8e1cea283344d66b2949312b674aa09`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:55.079139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:55.251945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 821/1654] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:56.773860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:56.775418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:56.929912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272814b-9948-4715-8b7d-ade28e554da0 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:56.939966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:56.940702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:56.941021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:56.941295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:56.950031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:57.120906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:57.126359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:57.163953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 834/1655] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:57.283269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:57.285659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:57.339026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec799a-a6d0-42c2-a51a-8b8d8ff301a2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:57.368930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:57.369906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:57.388273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:57.388915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] PATH_INFO: `/v3/projects/d6cef612493046db82d69042d0f70075` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:57.396062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cef612493046db82d69042d0f70075)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:57.401297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: WARNING py.warnings [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:43:57.401297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: warnings.warn(msg) Aug 31 10:43:57.401297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: Aug 31 10:43:57.404588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:57.581678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:57.602474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cef612493046db82d69042d0f70075', 'request_id': 'req-3abc9301-7c46-43bb-b237-6b85a2590ad1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:57.648110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cef612493046db82d69042d0f70075', 'request_id': 'req-3abc9301-7c46-43bb-b237-6b85a2590ad1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:57.670742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cef612493046db82d69042d0f70075', 'request_id': 'req-3abc9301-7c46-43bb-b237-6b85a2590ad1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:57.718694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] The token cache is being invalidate because project d6cef612493046db82d69042d0f70075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:43:57.718990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:57.720960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3abc9301-7c46-43bb-b237-6b85a2590ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:57.723897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 822/1656] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:43:57 2022] DELETE /identity/v3/projects/d6cef612493046db82d69042d0f70075 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:57.727533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:57.743797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57560ab9-9ea5-4d0d-8910-bb8d3c562ab5 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:57.947006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:57.947631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:57.947913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:57.948185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] PATH_INFO: `/v3/users/45a9a56a792c4ca1b076ec00799ceddc` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:57.955386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a9a56a792c4ca1b076ec00799ceddc)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:57.959988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:57.978640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:58.049262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a9a56a792c4ca1b076ec00799ceddc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:58.051191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a9a56a792c4ca1b076ec00799ceddc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:58.081856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a9a56a792c4ca1b076ec00799ceddc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:58.117022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a9a56a792c4ca1b076ec00799ceddc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:58.139993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8bc4274c-9533-49ff-990b-f7722f8055bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a9a56a792c4ca1b076ec00799ceddc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:58.158883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 835/1657] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:43:57 2022] DELETE /identity/v3/users/45a9a56a792c4ca1b076ec00799ceddc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:58.602133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:58.602702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:58.602885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:58.605042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 823/1658] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:58.647015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:58.647512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:58.649272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:58.695145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:58.699076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:58.875510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 836/1659] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:43:59.266897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:59.272019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:59.299230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf274cc-d073-4b14-ab77-2742ac07537c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:59.308207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:59.309217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:59.309701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:59.310208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:59.341795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:59.344283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ac75-3562-4ecd-8224-50f7bdb5cb3c service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:59.360437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 824/1660] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:43:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:43:59.428263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:59.433931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:59.619315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8548deb-802e-4519-a542-95fcfe869504 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:59.637671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:59.638349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:59.638604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:59.638996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] PATH_INFO: `/v3/projects/333489239bcd4a7c977119d29289c07d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:59.640830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=333489239bcd4a7c977119d29289c07d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:59.646271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:59.727837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:59.756280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333489239bcd4a7c977119d29289c07d', 'request_id': 'req-604b14c0-b0db-4c46-be7e-dd556ebff78f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:59.772488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333489239bcd4a7c977119d29289c07d', 'request_id': 'req-604b14c0-b0db-4c46-be7e-dd556ebff78f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:59.793825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333489239bcd4a7c977119d29289c07d', 'request_id': 'req-604b14c0-b0db-4c46-be7e-dd556ebff78f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:59.811834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] The token cache is being invalidate because project 333489239bcd4a7c977119d29289c07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:43:59.812139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:59.812939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-604b14c0-b0db-4c46-be7e-dd556ebff78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:43:59.819038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 837/1661] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:43:59 2022] DELETE /identity/v3/projects/333489239bcd4a7c977119d29289c07d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:59.823800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:59.824289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:59.824567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:59.866553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:59.870032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:00.063908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 825/1662] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:00.075501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.076117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.076740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.170644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:00.173077 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:00.219384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 838/1663] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:00.221508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.253831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9b4c9-a2dc-4e30-9053-c816af767b2b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.291262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.292282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.292802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.293418 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.300634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:00.302076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.319750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.399226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 826/1664] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:00.399591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.431255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c955c-269b-4ff8-8f88-6e395e781c56 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.446583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.448236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.449786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.450551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.451945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.456134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.546841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 839/1665] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:00 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:00.551888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.567181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508fce-0fe1-4fd3-8c3d-4e737e84bf54 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.599765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.601929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:00.703748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.704374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.704648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.704965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.705741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.707747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.749335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1283be-547a-4148-9ffe-6315eb8b2010 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.755503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 827/1666] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:00 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:00.759584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.769066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.770418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.771180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.772987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] PATH_INFO: `/v3/users/972c172ec4ba438180ad77dc9b6e6917` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.776669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972c172ec4ba438180ad77dc9b6e6917)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.782356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.786787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e1a43-2481-4cd3-b094-56cd7cbb9b8c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.798371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.798998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.799270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.802410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.803051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.805863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.835413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 828/1667] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:00.836246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.864783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacb64-b5ec-4e0f-b852-4bbf8d7d0b7b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.879270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.879902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.880178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.880448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.881125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:00.882747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:00.902627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972c172ec4ba438180ad77dc9b6e6917'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:00.904427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972c172ec4ba438180ad77dc9b6e6917'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:00.905574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 829/1668] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:00.910440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:00.923475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972c172ec4ba438180ad77dc9b6e6917'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:00.948018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972c172ec4ba438180ad77dc9b6e6917'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:00.965650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4136021f-44b4-4f44-904a-2ce6179677b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972c172ec4ba438180ad77dc9b6e6917'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:00.976186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf67-16e7-4f12-9774-2a99a3ccc2bb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:00.983502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 840/1669] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:00 2022] DELETE /identity/v3/users/972c172ec4ba438180ad77dc9b6e6917 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:00.989405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.989698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.990028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:00.994867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:00.995572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:00.995850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:00.996876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] PATH_INFO: `/v3/projects/58367a8b23b74aa39aa0ca41ad403721/users/80579cecfae848179f7926440ceea8e3/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.035849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:01.036180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:01.037185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:01.050737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:01.054551 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=58367a8b23b74aa39aa0ca41ad403721, user_id=80579cecfae848179f7926440ceea8e3, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:01.057330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df823bc7-2413-4343-8331-bb6688271ffd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:01.118651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 830/1670] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:00 2022] PUT /identity/v3/projects/58367a8b23b74aa39aa0ca41ad403721/users/80579cecfae848179f7926440ceea8e3/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:01.134721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e934a-2209-439d-9462-913b0eb50125 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:01.134721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e934a-2209-439d-9462-913b0eb50125 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:01.134721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e934a-2209-439d-9462-913b0eb50125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.248154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 841/1671] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:01.248450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-091e934a-2209-439d-9462-913b0eb50125 None None] MFA Rules not processed for user `80579cecfae848179f7926440ceea8e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:01.250357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-091e934a-2209-439d-9462-913b0eb50125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:01.315867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:01.317510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:01.452588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 831/1672] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:01.457939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e934a-2209-439d-9462-913b0eb50125 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:01.460376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-091e934a-2209-439d-9462-913b0eb50125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:01.560276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444bfa5-b895-4368-a3b2-290c8f5012dd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:01.594517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e934a-2209-439d-9462-913b0eb50125 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:01.600451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:01.601400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:01.601873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:01.602310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.605396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:01.607614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:01.660904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 832/1673] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:01 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:01.665889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:01.690103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:01.692175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:01.692656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:01.693135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.714065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:01.718042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:01.742534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 842/1674] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:01.832352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a8ff1-36ef-4cd8-987c-13fa0bd07750 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:01.841914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:01.843692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:01.845754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:01.846469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.849139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:01.853936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:01.875540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:01.910641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:01.911784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 833/1675] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:01 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:01.923706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2823ced-ecde-427f-8724-1f95bae0d750 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:01.938213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:01.939525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:01.939813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:01.940090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:01.941127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:01.942753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:01.962938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 843/1676] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:01.964241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:01.986396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c87cb-0c03-4929-a8a7-1fa2bb6caa4e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.002682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:02.003713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.003986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.004348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] PATH_INFO: `/v3/projects/d89636acf6a149a4b8acaaa117110363/users/14e6b2716aad4cb382ca1ad98a1ecb99/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.045681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89636acf6a149a4b8acaaa117110363, user_id=14e6b2716aad4cb382ca1ad98a1ecb99, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:02.048559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:02.080413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 834/1677] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:01 2022] PUT /identity/v3/projects/d89636acf6a149a4b8acaaa117110363/users/14e6b2716aad4cb382ca1ad98a1ecb99/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:02.081689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:02.096193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1286-7f0a-4fe6-bd51-ec962d858e73 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.210931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:02.226610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:02.227732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.228547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.229749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.230957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:02.233526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a21a0-82d1-4ffb-9235-6803b226a810 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:02.255752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:02.257576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 844/1678] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:02.279016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c8f55-e753-4a03-b5a9-ecbd709b4ba6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.287883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:02.289042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.289775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.290255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] PATH_INFO: `/v3/projects/d89636acf6a149a4b8acaaa117110363/users/14e6b2716aad4cb382ca1ad98a1ecb99/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.292782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89636acf6a149a4b8acaaa117110363, user_id=14e6b2716aad4cb382ca1ad98a1ecb99, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:02.297496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f45-338b-4c41-8a77-3f8c4ebfb83e None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.298087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f45-338b-4c41-8a77-3f8c4ebfb83e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.298550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f45-338b-4c41-8a77-3f8c4ebfb83e None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.302311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 845/1679] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:44:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:44:02.304605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935800e4-4553-479f-93fc-876b163af237 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:02.334349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.334673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.334925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.335218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 835/1680] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:02 2022] PUT /identity/v3/projects/d89636acf6a149a4b8acaaa117110363/users/14e6b2716aad4cb382ca1ad98a1ecb99/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:02.341110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.343048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.344290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.401248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:02.404678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:02.410985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] MFA Rules not processed for user `14e6b2716aad4cb382ca1ad98a1ecb99`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:02.412261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:02.562493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 846/1681] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:02.563383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:02.564866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:02.591260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 836/1682] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:02.592320 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:02.593894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:02.721173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0755ff9-b622-42ea-ba7d-f835aab70dcf None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.733006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:02.733533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.733811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.734548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] PATH_INFO: `/v3/users/5abca67fb0074b5a915f61957470501d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.741630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abca67fb0074b5a915f61957470501d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:02.742004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049a0f5-b36c-475b-9dc6-6fd351bc3d18 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.743556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:02.762729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:02.763496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:02.763850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:02.764139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:02.829520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:02.837628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:02.891470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abca67fb0074b5a915f61957470501d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:02.892308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 837/1683] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:02.893190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abca67fb0074b5a915f61957470501d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:02.901920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:02.906298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:02.937682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abca67fb0074b5a915f61957470501d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:02.992888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2e7f4-81a5-49b6-83e0-a20b9f905a5f service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:02.996252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abca67fb0074b5a915f61957470501d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:03.010430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:03.011144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:03.011491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:03.011857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:03.044241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abca67fb0074b5a915f61957470501d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:03.052075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:03.058389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:03.060480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:03.066227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 847/1684] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:02 2022] DELETE /identity/v3/users/5abca67fb0074b5a915f61957470501d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:03.097815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 838/1685] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:03.902940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:03.910358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:04.086416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81ca4f-ef2f-44ca-bbeb-eff46a8ab5de admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:04.099669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:04.100545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:04.100659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:04.100906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] PATH_INFO: `/v3/users/80579cecfae848179f7926440ceea8e3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:04.109918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80579cecfae848179f7926440ceea8e3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:04.112039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:04.260080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80579cecfae848179f7926440ceea8e3'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.261387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80579cecfae848179f7926440ceea8e3'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.286363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80579cecfae848179f7926440ceea8e3'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.319087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:04.326968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80579cecfae848179f7926440ceea8e3'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.342799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c0ca57a3-357a-4b40-9ea4-e45c33d96107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80579cecfae848179f7926440ceea8e3'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.346761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53a86-fcd4-46d7-ae65-7c4c4c2236e8 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:04.367697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 848/1686] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:03 2022] DELETE /identity/v3/users/80579cecfae848179f7926440ceea8e3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:04.373000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:04.373852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:04.374219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:04.374585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] PATH_INFO: `/v3/projects/c088ebc5e9ea4b54b5218d0f6bca3722` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:04.374699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:04.378556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c088ebc5e9ea4b54b5218d0f6bca3722)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:04.378719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:04.379297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:04.381015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:04.444551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:04.448688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:04.514270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:04.542405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c088ebc5e9ea4b54b5218d0f6bca3722', 'request_id': 'req-49c959d9-7f32-41e5-8d8c-743f9af11be7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.564450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c088ebc5e9ea4b54b5218d0f6bca3722', 'request_id': 'req-49c959d9-7f32-41e5-8d8c-743f9af11be7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.600017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c088ebc5e9ea4b54b5218d0f6bca3722', 'request_id': 'req-49c959d9-7f32-41e5-8d8c-743f9af11be7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.647234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] The token cache is being invalidate because project c088ebc5e9ea4b54b5218d0f6bca3722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:04.647532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.653180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.655259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 839/1687] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:04 2022] DELETE /identity/v3/projects/c088ebc5e9ea4b54b5218d0f6bca3722 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:04.664014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:04.665735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:04.673668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 849/1688] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:04.722651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:04.724128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:04.746878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d193781-8a2c-4078-8285-178b02ef7db3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:04.778794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:04.844622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c959d9-7f32-41e5-8d8c-743f9af11be7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:04.861517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:04.862901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:04.863281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:04.863654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] PATH_INFO: `/v3/users/b8e1cea283344d66b2949312b674aa09` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:04.866109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e1cea283344d66b2949312b674aa09)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:04.868196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:04.873734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:04.874396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:04.874850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:04.874965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] PATH_INFO: `/v3/projects/e1aa91bfc5de4d06b98fef2fc79fb329` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:04.876419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1aa91bfc5de4d06b98fef2fc79fb329)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:04.880158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:04.961768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1aa91bfc5de4d06b98fef2fc79fb329', 'request_id': 'req-92618070-5fa6-44bc-b008-6b14399bfde8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.969194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1aa91bfc5de4d06b98fef2fc79fb329', 'request_id': 'req-92618070-5fa6-44bc-b008-6b14399bfde8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:04.990269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1aa91bfc5de4d06b98fef2fc79fb329', 'request_id': 'req-92618070-5fa6-44bc-b008-6b14399bfde8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.010311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] The token cache is being invalidate because project e1aa91bfc5de4d06b98fef2fc79fb329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:05.011083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.011927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.015614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 850/1689] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:04 2022] DELETE /identity/v3/projects/e1aa91bfc5de4d06b98fef2fc79fb329 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:05.016933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.019842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:05.089539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e1cea283344d66b2949312b674aa09'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.106208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e1cea283344d66b2949312b674aa09'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.111300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e1cea283344d66b2949312b674aa09'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.112802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e1cea283344d66b2949312b674aa09'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.135005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-091521aa-1c73-40d8-b3cc-cbd107c6f3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e1cea283344d66b2949312b674aa09'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:05.154618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 840/1690] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:04 2022] DELETE /identity/v3/users/b8e1cea283344d66b2949312b674aa09 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:05.154618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c0f30-1706-44a3-8bc8-6ecbaa3065a3 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.154618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c0f30-1706-44a3-8bc8-6ecbaa3065a3 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.154618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c0f30-1706-44a3-8bc8-6ecbaa3065a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.188704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-959c0f30-1706-44a3-8bc8-6ecbaa3065a3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:05.190211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-959c0f30-1706-44a3-8bc8-6ecbaa3065a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:05.195262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92618070-5fa6-44bc-b008-6b14399bfde8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.279170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:05.326131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.327463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.327904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.329698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.335148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:05.340527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 841/1691] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:05.349221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.349713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.350154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.371440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.374637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.400453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 851/1692] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:05.408057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:05.410133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:05.419238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 842/1693] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:05.423187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.434439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0999b-c495-4c89-912b-258b6534fd5b service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.439918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.444413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.445062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.445286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.446120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:05.446653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.448925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.450368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:05.471332 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.478030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 852/1694] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:05.482330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94728513-49ca-4bc1-a7b9-d69b07f51d66 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.494990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.495779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.496160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.496657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.497455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.499696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.556530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.557533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 843/1695] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:05 2022] POST /identity/v3/projects => generated 357 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:05.572485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c3a21-454c-45d7-ab33-1a6e1d083b6e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.653033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.654030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.654625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.655197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.656098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.658658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.707707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 853/1696] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:05 2022] POST /identity/v3/users => generated 279 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:05.708652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.725521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062fa2e-b008-4c95-9f7c-a4dcfc063eb2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.762902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.764202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.765820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.767030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.772563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.774455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.818803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 844/1697] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:05.819811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.842919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794ef74-75c8-4345-9cd1-41b5ec6eb9cd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.865618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.866500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.869287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.871253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.872718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:05.878510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9fbf7-7d47-4693-ac66-377dcc4c449b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:05.908896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 854/1698] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:05.913374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:05.930931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.949594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.949968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:05.950631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df72b5-34ed-4862-b00f-6647e58b1903 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:05.972297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:05.974609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:05.974896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:05.975171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] PATH_INFO: `/v3/projects/661b707760d84784b2c1921738132f43/users/e4a468edae49477c945394b57e0fca76/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.059600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661b707760d84784b2c1921738132f43, user_id=e4a468edae49477c945394b57e0fca76, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:06.072201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a87f8-af92-4c35-80c9-a4d43d8701d5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:06.079044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] MFA Rules not processed for user `9cd5a46657f641e7b0db8684963c0246`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:06.081182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.113594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 845/1699] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:05 2022] PUT /identity/v3/projects/661b707760d84784b2c1921738132f43/users/e4a468edae49477c945394b57e0fca76/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:06.127554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.129357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.129974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.225474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 855/1700] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:06.225697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] MFA Rules not processed for user `e4a468edae49477c945394b57e0fca76`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:06.225777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:06.225882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.225959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.270116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940002b-9bed-44a7-a6e9-ae13848416e2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:06.352337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 846/1701] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:06.354442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:06.355970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.424293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:06.425643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.425983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.426316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] PATH_INFO: `/v3/projects/49be235dad324e79b3e05a8e7ccec10f` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.429412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49be235dad324e79b3e05a8e7ccec10f)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:06.431418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:06.435277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:06.507421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49be235dad324e79b3e05a8e7ccec10f', 'request_id': 'req-0690bce9-427e-4875-8794-227faeb1f698'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:06.508522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125870a-3737-4689-999f-14cd45d60fe7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:06.514608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:06.535408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49be235dad324e79b3e05a8e7ccec10f', 'request_id': 'req-0690bce9-427e-4875-8794-227faeb1f698'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:06.568939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49be235dad324e79b3e05a8e7ccec10f', 'request_id': 'req-0690bce9-427e-4875-8794-227faeb1f698'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:06.594701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] The token cache is being invalidate because project 49be235dad324e79b3e05a8e7ccec10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:06.597926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:06.599844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:06.605503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 856/1702] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:06 2022] DELETE /identity/v3/projects/49be235dad324e79b3e05a8e7ccec10f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:06.606907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:06.610152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.663900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:06.664838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.665264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.665703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.672709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.756630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bce9-427e-4875-8794-227faeb1f698 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:06.772730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:06.773929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.774223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.774497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.776396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:06.778917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:06.796444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:06.817735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9858c7-3628-49bd-8c4c-9550d4be427a service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:06.829305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 847/1703] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:06.830671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.831684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.832030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:06.841966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 857/1704] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:06 2022] POST /identity/v3/projects => generated 357 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:06.855435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:06.857439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:06.858894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.859043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:06.965179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 848/1705] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:06.966049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:06.984729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d077989-062c-4cd3-b3ce-edd6d58999fe None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:06.998675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:06.999315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:06.999593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:06.999862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.000979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.002542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490d91b-1df8-4e17-938a-55a128e366e7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.013622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beb976-97bc-4614-a387-a0cc986657ba admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.022919 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.024657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.025207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.025745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] PATH_INFO: `/v3/projects/58367a8b23b74aa39aa0ca41ad403721` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.027652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=58367a8b23b74aa39aa0ca41ad403721)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.037045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.077567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 849/1706] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:06 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:07.077567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.077567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.077567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.101648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:07.103504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.115929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 850/1707] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:07.117149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.119388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:07.131701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2046c-0bce-4d50-b566-91793a4f4b92 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.145388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.146432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.147854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.148300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.149575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.151524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.168168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 851/1708] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:07.169184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.190560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15756-3f76-476e-92b8-05bbc902d371 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.213334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:07.218778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58367a8b23b74aa39aa0ca41ad403721', 'request_id': 'req-3ebcea51-197e-4d5b-8169-2be56016ecdb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.249598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58367a8b23b74aa39aa0ca41ad403721', 'request_id': 'req-3ebcea51-197e-4d5b-8169-2be56016ecdb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.267726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58367a8b23b74aa39aa0ca41ad403721', 'request_id': 'req-3ebcea51-197e-4d5b-8169-2be56016ecdb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.316486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] The token cache is being invalidate because project 58367a8b23b74aa39aa0ca41ad403721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:07.316879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.319170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.323746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 858/1709] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:06 2022] DELETE /identity/v3/projects/58367a8b23b74aa39aa0ca41ad403721 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:07.327320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.336454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.351469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.352271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.352813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.353342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.353946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:07.354337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.357091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.374925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 852/1710] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:07.375961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.378260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.388110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcea51-197e-4d5b-8169-2be56016ecdb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.395307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.396031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.396316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.396593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] PATH_INFO: `/v3/projects/691b48da922a435fa12e2c2313a6e241/users/afba3e5b1bbe48d49e865e3f81f90b80/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.428869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd07b-5f10-400a-8f6c-4717c69d06b8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.444379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691b48da922a435fa12e2c2313a6e241, user_id=afba3e5b1bbe48d49e865e3f81f90b80, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.454510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.455584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.456630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.457161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] PATH_INFO: `/v3/users/14e6b2716aad4cb382ca1ad98a1ecb99` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.459247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.474158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e6b2716aad4cb382ca1ad98a1ecb99)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.479609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.483174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 859/1711] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:07 2022] PUT /identity/v3/projects/691b48da922a435fa12e2c2313a6e241/users/afba3e5b1bbe48d49e865e3f81f90b80/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:07.487387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.492523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.609260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e6b2716aad4cb382ca1ad98a1ecb99'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.628402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e6b2716aad4cb382ca1ad98a1ecb99'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.629177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e6b2716aad4cb382ca1ad98a1ecb99'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.630596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e6b2716aad4cb382ca1ad98a1ecb99'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.656604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e6b2716aad4cb382ca1ad98a1ecb99'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:07.679146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 853/1712] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:07 2022] DELETE /identity/v3/users/14e6b2716aad4cb382ca1ad98a1ecb99 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:07.679146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.680132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.694435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468e492-4f7a-4c28-a53f-26824b4e6de1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.768595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312a667-920c-4df6-8ea0-2bd795ad6c21 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.776059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.776778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.777197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.777479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.778788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.781357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.796062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 854/1713] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:07.804796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.814065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b3cce-300d-4aa1-bb42-03538d680586 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:07.821282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.823006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.823162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.823446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] PATH_INFO: `/v3/projects/691b48da922a435fa12e2c2313a6e241/users/afba3e5b1bbe48d49e865e3f81f90b80/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.825557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691b48da922a435fa12e2c2313a6e241, user_id=afba3e5b1bbe48d49e865e3f81f90b80, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.828599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a0e03-7371-4053-af12-9967d42e1629 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.871974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:07.895986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 855/1714] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:07 2022] PUT /identity/v3/projects/691b48da922a435fa12e2c2313a6e241/users/afba3e5b1bbe48d49e865e3f81f90b80/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:07.906200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:07.906937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.907234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.907512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:07.907617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.907869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:07.908056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:07.908226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:07.912464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:07.979214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] MFA Rules not processed for user `afba3e5b1bbe48d49e865e3f81f90b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:07.982956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:07.984398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 860/1715] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:07 2022] POST /identity/v3/projects => generated 381 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:07.989369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:07.991935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:08.044817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:08.157995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 856/1716] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:08.176261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8d1e-01fd-4ef4-81e6-50de0b1d5c1c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.185735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:08.187330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:08.201065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.202409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.202838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.203522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.204313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.211514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.275445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 861/1717] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:07 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:08.276749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:08.311707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f4007-9e80-4638-831b-8878c409adc7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.326959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.327591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.327873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.328147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.329690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.334141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.336193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968397cc-eece-4c98-a2a1-ca993016b276 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.347168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.348041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.348041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.348335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.359943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 862/1718] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:08.362175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:08.377106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.379344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a7ad-dd4e-4aad-b43f-555b1dc4eccf service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.406087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ea299-8b04-4b8c-81ca-0dd1a411a903 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.411325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 857/1719] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:08.414464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276778-80d8-46e9-a5e9-d01de5ee7a27 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.414999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276778-80d8-46e9-a5e9-d01de5ee7a27 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.415531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.416192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276778-80d8-46e9-a5e9-d01de5ee7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.416311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.417037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.417142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.417785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.421732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.457140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 863/1720] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:08.459946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:08.488598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e080-10fd-4f64-a232-7de9014f5748 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.500048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-14276778-80d8-46e9-a5e9-d01de5ee7a27 None None] MFA Rules not processed for user `badb3837c71e4274b1868a3d0d2dfa82`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:08.500917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.502424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-14276778-80d8-46e9-a5e9-d01de5ee7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:08.503820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.504208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.505841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] PATH_INFO: `/v3/projects/514b688eb13342efb4bf30f49b782d27/users/44ee17b2bca64330b961d7ee7ea140d9/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.552670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=514b688eb13342efb4bf30f49b782d27, user_id=44ee17b2bca64330b961d7ee7ea140d9, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.557009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.588180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 864/1721] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:08 2022] PUT /identity/v3/projects/514b688eb13342efb4bf30f49b782d27/users/44ee17b2bca64330b961d7ee7ea140d9/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:08.589173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:08.668723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e34ada-a25e-49b7-af43-54de4e4b02ff admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:08.673911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:08.674185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.674480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.674818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.677423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:08.679817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 858/1722] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:08.681247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.681536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.681813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.755012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] MFA Rules not processed for user `44ee17b2bca64330b961d7ee7ea140d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:08.755786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:08.773554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:08.880982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:08.885783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3545cad-e1e1-4930-b510-01fa067c27f9 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:08.920133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 865/1723] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:08.922741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:08.930929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:08.931210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:08.998331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] MFA Rules not processed for user `badb3837c71e4274b1868a3d0d2dfa82`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:08.999583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:09.025207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 859/1724] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:09.026353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:09.041862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:09.248892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640513b-b3dd-40ba-ad50-3209c022a259 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:09.262974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:09.265609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:09.265926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:09.266252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:09.266914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:09.270386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:09.279701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 866/1725] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:09.289948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:09.291761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:09.348503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 860/1726] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:09 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:09.350616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:09.571223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3954-4bcd-4daa-9e15-f85fa561ba66 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:09.576008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0bfb8-b25f-4c80-9e50-32a66961ab46 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:09.583538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:09.585228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:09.587021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:09.587523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:09.589582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:09.591783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:09.639483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 861/1727] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:09 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:09.641325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:09.647361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:09.678132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd275b-8c21-4d10-bcc6-ec4bfdb6306f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:09.685416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:09.686193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:09.686588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:09.686963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] PATH_INFO: `/v3/projects/d89636acf6a149a4b8acaaa117110363` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:09.689584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89636acf6a149a4b8acaaa117110363)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:09.695338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:09.733788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:09.735643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:09.736017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:09.736384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:09.738801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:09.805339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89636acf6a149a4b8acaaa117110363', 'request_id': 'req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:09.826977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89636acf6a149a4b8acaaa117110363', 'request_id': 'req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:09.850480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89636acf6a149a4b8acaaa117110363', 'request_id': 'req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:09.890286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] The token cache is being invalidate because project d89636acf6a149a4b8acaaa117110363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:09.890675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:09.895044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:09.900272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:09.901407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:09.904930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8b662-5e3f-42e9-a51b-4536192e27fb service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:09.912742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 862/1728] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:09 2022] DELETE /identity/v3/projects/d89636acf6a149a4b8acaaa117110363 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:09.912742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:09.917973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:09.926490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 867/1729] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:09.928444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:09.928827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:09.929201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.023126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] MFA Rules not processed for user `476c96600c524cc293bc0e0a65ee8cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:10.032460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:10.143158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d4cc7-2b35-46b0-a0b2-9c9722c2617c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.169795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.172106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.172399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.172721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.173384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:10.181073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d876d-1913-460a-bcf2-88b0e3422e83 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:10.219522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 863/1730] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:10.221801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.222621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.223058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.270117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 868/1731] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:10.271340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:10.272057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:10.273546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:10.317385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 864/1732] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:10.321183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:10.327667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:10.330027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c28d45-4ec0-4520-81cb-7080f247dfae None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.343846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.344716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.345163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.349872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] PATH_INFO: `/v3/projects/27a8e3c1ddef4056826ac80363260b34/users/d66febf8ce644a798f73e7b208c879f2/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.407936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a8e3c1ddef4056826ac80363260b34, user_id=d66febf8ce644a798f73e7b208c879f2, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:10.411938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ea45a-d63d-4e02-962b-daa166f98ed1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:10.446821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 869/1733] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:10 2022] PUT /identity/v3/projects/27a8e3c1ddef4056826ac80363260b34/users/d66febf8ce644a798f73e7b208c879f2/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:10.448794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.448794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.448993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.499511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:10.500696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:10.585188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeb0b0-e20f-43dc-b6a6-65a8f3b6695e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.669278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 870/1734] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:10.670308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:10.686631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9624-2862-47a3-82a7-2f5330d1b84e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.694562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:10.704795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.705461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.705759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.706066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.706937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:10.710050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:10.740984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 871/1735] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:10.744120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:10.764395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b5dfd-a7dd-42cc-9bd1-e50ac159ca0b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.777656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.778726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.779008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.779286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.779944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:10.782417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:10.787162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:10.810549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.811699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.819637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.824436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.824592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 872/1736] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:10.827309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:10.846106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d3c42-23df-42a9-8192-aa1a499d4fa9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:10.865259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:10.865963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:10.866240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:10.866511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] PATH_INFO: `/v3/projects/27a8e3c1ddef4056826ac80363260b34/users/d66febf8ce644a798f73e7b208c879f2/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:10.869780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a8e3c1ddef4056826ac80363260b34, user_id=d66febf8ce644a798f73e7b208c879f2, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:10.875777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:10.925163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 873/1737] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:10 2022] PUT /identity/v3/projects/27a8e3c1ddef4056826ac80363260b34/users/d66febf8ce644a798f73e7b208c879f2/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:10.926352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:11.025595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:11.076339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:11.080203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a98c95-961c-465b-992b-15a5f3623779 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:11.105309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 865/1738] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:11.126107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.126107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.128621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.152250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3755f07-b041-482d-a120-4d634fe994f9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:11.185785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:11.192295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.192584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.195185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.195921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:11.208000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04075732-de09-46e2-9b2e-435099088089 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:11.223132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] MFA Rules not processed for user `d66febf8ce644a798f73e7b208c879f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:11.226036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:11.336940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 874/1739] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:10 2022] POST /identity/v3/projects => generated 365 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:11.338983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.338983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.338983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.413633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] MFA Rules not processed for user `9cd5a46657f641e7b0db8684963c0246`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:11.415034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:11.445800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 866/1740] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:11.446840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:11.469549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ab6c6-2d3a-4328-8f20-36dd3e3e2920 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:11.601150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:11.610555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 875/1741] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:11.616843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:11.619205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:11.673229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:11.677613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.679734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.680143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.685645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:11.695003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63facf21-86c3-4338-ba43-687625f8693d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:11.742547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 867/1742] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:11 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:11.745968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df8de-0fe6-49f8-b457-b48fc0e60150 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.746665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df8de-0fe6-49f8-b457-b48fc0e60150 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.746665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415df8de-0fe6-49f8-b457-b48fc0e60150 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.750950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 868/1743] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 31 10:44:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:11.751909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df8de-0fe6-49f8-b457-b48fc0e60150 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:11.769403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415df8de-0fe6-49f8-b457-b48fc0e60150 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:11.776822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:11.777583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.777986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.778333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.779101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:11.781275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea6fef-2a3e-4788-a155-7dc34ec6d752 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:11.804485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 869/1744] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:11.804485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec5ae-d6ce-4b27-9872-507d267337b0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.804485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec5ae-d6ce-4b27-9872-507d267337b0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.804485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ec5ae-d6ce-4b27-9872-507d267337b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.809934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dcd13-1c80-44b7-8b04-659b37d475ce None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:11.818684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:11.819334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:11.819582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:11.819852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:11.933882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bc7ec5ae-d6ce-4b27-9872-507d267337b0 None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:11.937129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bc7ec5ae-d6ce-4b27-9872-507d267337b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:12.070774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:12.072853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:12.088216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 876/1745] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:12.089570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:12.096633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:12.104627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a24a0f-0fd0-46d2-a7b5-42d20a5b2ee0 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:12.127209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:12.129912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:12.130758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:12.133571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:12.136849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:12.141301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:12.176791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 870/1746] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:12.181550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c116-230b-4a0c-bdfb-d95c9a36fb15 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:12.183796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c116-230b-4a0c-bdfb-d95c9a36fb15 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:12.184123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c116-230b-4a0c-bdfb-d95c9a36fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:12.199801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 877/1747] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:12.203514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:12.264319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce1dfa9-c496-4962-a079-14ac9881e6db admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:12.302353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:12.306185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1670c116-230b-4a0c-bdfb-d95c9a36fb15 None None] MFA Rules not processed for user `0639368c7c8f4c6a835a776272840004`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:12.306389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:12.306660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:12.308350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1670c116-230b-4a0c-bdfb-d95c9a36fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:12.308972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] PATH_INFO: `/v3/projects/358a260d5bf84a5e829cc9257bf0ca8c/users/a77bf373425e4a4faff6cfcf67182882/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:12.386477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358a260d5bf84a5e829cc9257bf0ca8c, user_id=a77bf373425e4a4faff6cfcf67182882, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:12.389802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:12.433822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 878/1748] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:12 2022] PUT /identity/v3/projects/358a260d5bf84a5e829cc9257bf0ca8c/users/a77bf373425e4a4faff6cfcf67182882/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:12.435076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:12.520163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 871/1749] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:12.531558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:12.534990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:12.535446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:12.591167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bd47f-5cc3-477a-a27d-9621f5c6e5c4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:12.600798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:12.603233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:12.603233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:12.603233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:12.606990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:12.630113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] MFA Rules not processed for user `a77bf373425e4a4faff6cfcf67182882`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:12.631920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:12.772630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:12.773063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:12.776541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:12.829821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 872/1750] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:12.829821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:12.830244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 879/1751] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:12.834028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:12.849329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.046849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f639c-d7b8-4f25-8779-9876123b9943 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.057216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.057915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.058200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.058474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.078289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.079777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d6fab-4dd8-4bc5-85c5-942546374a15 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.101816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a6a8b-55e9-40ca-abf3-e1e6e24885c9 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.102118 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 873/1752] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:13.103427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5495-1952-48e8-84f3-51329938347a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.103718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5495-1952-48e8-84f3-51329938347a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.104057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e5495-1952-48e8-84f3-51329938347a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.109175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 874/1753] 10.222.0.70 () {54 vars in 912 bytes} [Wed Aug 31 10:44:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:13.115645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.115928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.116199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.132808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.134361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.134617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.134894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.137115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.152680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.183003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:13.194189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:13.220913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 875/1754] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:44:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:13.279178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 880/1755] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:12 2022] POST /identity/v3/projects => generated 363 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:13.285477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.301354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.312795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3e157-15c1-4ec7-b14f-c9c6f57c8bb5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.322319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:13.453321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.454192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.454538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.455273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.457167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.459678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.492962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79f01-fccb-4ea8-801c-dc179cf2aea7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.507909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.508545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.508846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.509120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.509864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 876/1756] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:13 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:13.513617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.528739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.530283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.533558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d23419-67da-4658-999d-2cdaf442492e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.541301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.542432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.543042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.544321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.545191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.548719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.551808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 881/1757] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:13.566001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 877/1758] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:13.569893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.592649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739732-5a02-4a54-9f31-032281cebe94 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.601790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.602468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.602752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.603032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] PATH_INFO: `/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08/users/fff11b4064bd43539d0fc09621db8a8b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.630926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bff3bc2130348fb8bfa44b3214e7b08, user_id=fff11b4064bd43539d0fc09621db8a8b, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.634992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.661232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 882/1759] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:13 2022] PUT /identity/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08/users/fff11b4064bd43539d0fc09621db8a8b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:13.666746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.684067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aba81c-c64a-47c0-8b4c-83b3b9d15381 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.842682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.843486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.843977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.844357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.845180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.847663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96749f-170a-4d27-9d7a-8002a23e40ea admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:13.860420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:13.881328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 878/1760] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:13.886685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:13.926062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff6e52-b889-469e-909b-31683b8a172a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:13.972174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:13.974270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:13.976868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:13.977186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] PATH_INFO: `/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08/users/fff11b4064bd43539d0fc09621db8a8b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:13.983733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bff3bc2130348fb8bfa44b3214e7b08, user_id=fff11b4064bd43539d0fc09621db8a8b, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:13.997577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:14.054775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 883/1761] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:13 2022] PUT /identity/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08/users/fff11b4064bd43539d0fc09621db8a8b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:14.057306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.057779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.058299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.120669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:14.123994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.135439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] MFA Rules not processed for user `fff11b4064bd43539d0fc09621db8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:14.140787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.336566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 879/1762] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:14.337728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:14.343101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.369788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc2864-8c18-4397-b8b0-f60d2444c3e0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:14.376180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:14.376969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.377317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.378219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.486442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:14.489648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:14.517557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 884/1763] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:14.519990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:14.530681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.531434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d49b1-a840-4532-9717-2f9a864990af None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:14.537786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:14.538857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.539149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.539424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.544085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.556525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:14.591797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:14.595826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d61061-1a9b-4a97-b4df-11bcf928702d service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:14.625847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 880/1764] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:14.629378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75e5a-98c8-4e6d-9ec1-a7dbf4b4368a None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.629664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75e5a-98c8-4e6d-9ec1-a7dbf4b4368a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.629935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b75e5a-98c8-4e6d-9ec1-a7dbf4b4368a None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.634654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 881/1765] 10.222.0.70 () {54 vars in 961 bytes} [Wed Aug 31 10:44:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:14.639707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.640195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.640740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.688529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c6bf2-1108-4400-8d22-9c949806bbb8 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:14.689824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] MFA Rules not processed for user `72b84b6ae6034eefabc8156213f20797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:14.693106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:14.701037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:14.701840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.702429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.702803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.714236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 882/1766] 10.222.0.70 () {58 vars in 1058 bytes} [Wed Aug 31 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:14.729112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:14.730688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:14.732886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:14.755972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d908e74-d12c-406b-9082-3f260b2411f1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:14.757784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 885/1767] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:14.777299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:14.778043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:14.779888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:14.780409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:14.807934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:14.809326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:14.840305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 883/1768] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:15.067147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:15.068705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:15.213948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058ae8d-3c78-459e-a4b9-ddb2ee0ae972 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:15.220495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:15.229349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:15.232024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:15.232898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:15.233574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] PATH_INFO: `/v3/users/6eea998fa82245aeb938501a16bd94a2` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:15.236606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eea998fa82245aeb938501a16bd94a2)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:15.253821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:15.256562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cb797-1955-444f-9680-ec22d54e1595 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:15.278921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:15.279547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:15.279830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:15.280106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:15.389550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eea998fa82245aeb938501a16bd94a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:15.390589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eea998fa82245aeb938501a16bd94a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:15.410223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eea998fa82245aeb938501a16bd94a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:15.426216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:15.444662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:15.447299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a7db0-5f54-4e79-b37c-d13769a06a45 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:15.465790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eea998fa82245aeb938501a16bd94a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:15.525880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 884/1769] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:15.530213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eea998fa82245aeb938501a16bd94a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:15.560430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 886/1770] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:15 2022] DELETE /identity/v3/users/6eea998fa82245aeb938501a16bd94a2 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:15.562612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd3fc-fd56-43da-94ae-d16f3d58b1a2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:15.563120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd3fc-fd56-43da-94ae-d16f3d58b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:15.563594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bd3fc-fd56-43da-94ae-d16f3d58b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:15.646584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fe3bd3fc-fd56-43da-94ae-d16f3d58b1a2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:15.654359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fe3bd3fc-fd56-43da-94ae-d16f3d58b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:15.863469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 885/1771] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:15.885888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:15.887330 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:15.989482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:16.044082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9a28e-be28-4767-801c-2c66d73615bd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:16.056068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:16.056715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:16.057044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:16.057349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:16.089998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:16.091461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:16.121885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 887/1772] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:16.679925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:16.680204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:16.680510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:16.751536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] MFA Rules not processed for user `476c96600c524cc293bc0e0a65ee8cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:16.762447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:16.959095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 886/1773] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:17.413665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:17.416827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:17.442628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7aa927-f7c2-4173-975b-3c0b354708d2 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:17.462191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:17.462991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:17.463378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:17.463755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] PATH_INFO: `/v3/projects/261b567d699b427ca7985d6467ec6e71` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:17.465046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261b567d699b427ca7985d6467ec6e71)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:17.476157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:17.608999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261b567d699b427ca7985d6467ec6e71', 'request_id': 'req-4635f27d-34d2-4773-b41a-0936c343cc97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:17.618910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261b567d699b427ca7985d6467ec6e71', 'request_id': 'req-4635f27d-34d2-4773-b41a-0936c343cc97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:17.634485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261b567d699b427ca7985d6467ec6e71', 'request_id': 'req-4635f27d-34d2-4773-b41a-0936c343cc97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:17.652368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] The token cache is being invalidate because project 261b567d699b427ca7985d6467ec6e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:17.652662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:17.654575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4635f27d-34d2-4773-b41a-0936c343cc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:17.663757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 888/1774] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:17 2022] DELETE /identity/v3/projects/261b567d699b427ca7985d6467ec6e71 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:17.669065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:17.691647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201ab29-6718-410b-90d8-13894e8acfea None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:17.826405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:17.833290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:17.833588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:17.833874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] PATH_INFO: `/v3/users/8915595efbc1416e8457afbbff79b638` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:17.841931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8915595efbc1416e8457afbbff79b638)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:17.844018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:17.984737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:18.006830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8915595efbc1416e8457afbbff79b638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:18.057857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8915595efbc1416e8457afbbff79b638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:18.058805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8915595efbc1416e8457afbbff79b638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:18.060666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8915595efbc1416e8457afbbff79b638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:18.108360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8915595efbc1416e8457afbbff79b638'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:18.148233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 887/1775] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:17 2022] DELETE /identity/v3/users/8915595efbc1416e8457afbbff79b638 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:19.153291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:19.154316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:19.154754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:19.256830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:19.259101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:19.528994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 889/1776] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:44:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:19.787933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:19.790176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:19.833482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:19.834907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:19.901684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:19.995817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b9a28-6818-44a5-84e5-37403ef54232 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:20.004968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:20.006509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.007010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.007501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] PATH_INFO: `/v3/users/a77bf373425e4a4faff6cfcf67182882` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.017998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77bf373425e4a4faff6cfcf67182882)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:20.022792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:20.086270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a091a5-dde4-407a-a8f7-f070434d1ce9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:20.104566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:20.105363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.105613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.105775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.127491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:20.129436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833326-8ac7-44fa-947c-4fe8d70e063e service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:20.139529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77bf373425e4a4faff6cfcf67182882'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:20.146427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 890/1777] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:44:20.151375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77bf373425e4a4faff6cfcf67182882'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:20.151375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77bf373425e4a4faff6cfcf67182882'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:20.152555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77bf373425e4a4faff6cfcf67182882'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:20.206522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77bf373425e4a4faff6cfcf67182882'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:20.281561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 888/1778] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:19 2022] DELETE /identity/v3/users/a77bf373425e4a4faff6cfcf67182882 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:20.288613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:20.289237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:20.289237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:20.376488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:20.381709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:20.637361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 891/1779] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:20.650916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:20.652613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:20.903883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:20.982051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0fe0c-ac64-4587-b8b5-3ee212b0aa13 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:21.042803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:21.043910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:21.063170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:21.063488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:21.076874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:21.078910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:21.108260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:21.110088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf4b-5e31-4e34-89c7-6e4a456084c7 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:21.124803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 889/1780] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:21.129981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f70a9f-3919-4ecf-9bfc-f268a08458c3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:21.156720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:21.159068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:21.165673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:21.166259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] PATH_INFO: `/v3/projects/8d99cec5b1674d5a9d6b512e597b6285` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:21.185100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d99cec5b1674d5a9d6b512e597b6285)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:21.191058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:21.449097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d99cec5b1674d5a9d6b512e597b6285', 'request_id': 'req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:21.470370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d99cec5b1674d5a9d6b512e597b6285', 'request_id': 'req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:21.505303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d99cec5b1674d5a9d6b512e597b6285', 'request_id': 'req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:21.567804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] The token cache is being invalidate because project 8d99cec5b1674d5a9d6b512e597b6285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:21.569352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:21.573019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4d2f74c9-da84-4b75-98c6-6ab17f1aa45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:21.579041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 892/1781] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:21 2022] DELETE /identity/v3/projects/8d99cec5b1674d5a9d6b512e597b6285 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:21.586408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baccb-0e51-410c-9319-9219604c9879 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:21.586408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baccb-0e51-410c-9319-9219604c9879 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:21.586602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182baccb-0e51-410c-9319-9219604c9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:21.642781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-182baccb-0e51-410c-9319-9219604c9879 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:21.653766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-182baccb-0e51-410c-9319-9219604c9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:21.892069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 890/1782] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:21.902661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:21.903364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:21.903850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.036532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:22.042236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.042779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.042885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.049014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:22.091116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 893/1783] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:22.097505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:22.106600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:22.108380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:22.130550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0000c-7f3b-49b2-8032-0d11b140243b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:22.159860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:22.162277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.165932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.166949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.171549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:22.177821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:22.182707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:22.231621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 894/1784] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:22.235560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:22.255197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:22.277003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927add0-8f8b-43d9-8db3-4bb9ee84804a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:22.306651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:22.307290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.313030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.313373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.314143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:22.321767 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c03c55-1962-464e-93ff-191a40cc3e4f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:22.344361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 891/1785] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Aug 31 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:22.362241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:22.364744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:22.386315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f23d8-b5e8-42cb-b889-1020505b3e13 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:22.400605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:22.402196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.415734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 895/1786] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:22 2022] POST /identity/v3/projects => generated 389 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:22.418369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.418796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.431858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.431858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.431858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.470236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:22.482990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:22.533234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 892/1787] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:22.539059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:22.543456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] MFA Rules not processed for user `0639368c7c8f4c6a835a776272840004`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:22.543456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:22.615070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44003e-c27d-4211-ab44-4540142edd97 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:22.810899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 896/1788] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:22.866058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:22.867923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:22.869499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:22.872866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:22.879561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:22.887631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:22.982325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 893/1789] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:22 2022] POST /identity/v3/users => generated 295 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:22.988483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.029698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3193df-e0e8-40b3-9b26-6ec76acb187c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.059924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.060599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.065526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.065865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.066567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.080121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.132398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.144956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 897/1790] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:23.157614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb9cdb-c015-4c6f-bc5b-934430c05ec5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.180014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.182401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.185143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.185819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.189308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.192381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.207057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:23.250186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 894/1791] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:23.255313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.277472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227fc7-17b1-4d8d-8aea-3458d4d8c70b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.279538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.281799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:23.290213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.291283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.294011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.294459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] PATH_INFO: `/v3/projects/cc0b8fdda0ac4147912f56b70030cc2c/users/aa14a82dac5c4571aec7713760e3eb74/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.319949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54559f1d-1fb7-4298-a391-c2c271a3ead4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.333479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0b8fdda0ac4147912f56b70030cc2c, user_id=aa14a82dac5c4571aec7713760e3eb74, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.337953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e9ec2-d897-4093-87e9-d8f8760e1bdf admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.339382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.340925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.341381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.341827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] PATH_INFO: `/v3/users/44ee17b2bca64330b961d7ee7ea140d9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.346743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ee17b2bca64330b961d7ee7ea140d9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:23.352501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:23.380873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 898/1792] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:23 2022] PUT /identity/v3/projects/cc0b8fdda0ac4147912f56b70030cc2c/users/aa14a82dac5c4571aec7713760e3eb74/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:23.382811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.383258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.383731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.480302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] MFA Rules not processed for user `aa14a82dac5c4571aec7713760e3eb74`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:23.482851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:23.528626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ee17b2bca64330b961d7ee7ea140d9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:23.554853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ee17b2bca64330b961d7ee7ea140d9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:23.556271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ee17b2bca64330b961d7ee7ea140d9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:23.560430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ee17b2bca64330b961d7ee7ea140d9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:23.621390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09834c77-6ef8-43d0-a40b-ef25dd34dc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ee17b2bca64330b961d7ee7ea140d9'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:23.681706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 895/1793] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:23 2022] DELETE /identity/v3/users/44ee17b2bca64330b961d7ee7ea140d9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:23.683206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.683533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:23.683799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:23.750671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:23.752549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:23.774278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 899/1794] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:23.779039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:23.780788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:23.856970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 896/1795] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:23.895345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:23.974705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb332ec-e5da-4dde-ae9f-ef1160aaa80c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:23.996310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:23.999051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:23.999471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.001180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.002684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.012529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.054691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.057408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:24.123250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 900/1796] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:23 2022] POST /identity/v3/projects => generated 387 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:24.123250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.128510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:24.379780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf9466-c9cb-455d-b1c4-91259af19048 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.407953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260376-431e-4685-ba1c-bed4d5669247 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.431079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.431744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.433420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.433767 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] PATH_INFO: `/v3/projects/358a260d5bf84a5e829cc9257bf0ca8c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.440830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] RBAC: Authorizing `identity:delete_project(project_id=358a260d5bf84a5e829cc9257bf0ca8c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.446554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.540550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358a260d5bf84a5e829cc9257bf0ca8c', 'request_id': 'req-fb0805dc-8c95-40a8-ba40-772ff70b631b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:24.541865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:24.551587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358a260d5bf84a5e829cc9257bf0ca8c', 'request_id': 'req-fb0805dc-8c95-40a8-ba40-772ff70b631b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:24.576733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358a260d5bf84a5e829cc9257bf0ca8c', 'request_id': 'req-fb0805dc-8c95-40a8-ba40-772ff70b631b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:24.582759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] The token cache is being invalidate because project 358a260d5bf84a5e829cc9257bf0ca8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:24.583224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:24.584397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:24.588240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 901/1797] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:24 2022] DELETE /identity/v3/projects/358a260d5bf84a5e829cc9257bf0ca8c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:24.589253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.591709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:24.678828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.679619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.680177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.680562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.687083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:24.699658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:24.707729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0805dc-8c95-40a8-ba40-772ff70b631b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.717017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.717966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.718257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.718528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.719214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.722902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.746942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.754673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.778119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 902/1798] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:24 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:24.779135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.783222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:24.805349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125692c-d7c8-47df-aafe-6efeb06fc4ee admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.808002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 897/1799] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:24.808988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.811319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.812468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.813125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.813597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] PATH_INFO: `/v3/users/fff11b4064bd43539d0fc09621db8a8b` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.819286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff11b4064bd43539d0fc09621db8a8b)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.842547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.853764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e08e1-881a-48e0-97dd-161982ea015c service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:24.885658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:24.886728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:24.887210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:24.887594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:24.888376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:24.894779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:24.952618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 898/1800] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:24.954144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:24.993168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d531250-e74b-4d6c-9789-51ebeb6f725f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.018655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.019518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.019942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.021634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] PATH_INFO: `/v3/projects/80cf767379b44ee29ed957abd7a092ee/users/3b666b034c30474ea526ce08f41d3d1d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.028744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff11b4064bd43539d0fc09621db8a8b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:25.032377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff11b4064bd43539d0fc09621db8a8b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:25.059413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff11b4064bd43539d0fc09621db8a8b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:25.075653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cf767379b44ee29ed957abd7a092ee, user_id=3b666b034c30474ea526ce08f41d3d1d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.086594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.099569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff11b4064bd43539d0fc09621db8a8b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:25.141728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 899/1801] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:24 2022] PUT /identity/v3/projects/80cf767379b44ee29ed957abd7a092ee/users/3b666b034c30474ea526ce08f41d3d1d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:25.145567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff11b4064bd43539d0fc09621db8a8b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:25.151941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.166183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 903/1802] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:24 2022] DELETE /identity/v3/users/fff11b4064bd43539d0fc09621db8a8b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:25.342300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640572e-b2e7-4523-b069-551c3697318e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.434584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.435443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.435699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.436107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.437249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.438814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf22dfe-a7d1-4231-901f-66908855a97f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.457483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.458204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 900/1803] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:25.459373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:25.476299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef64b5-5d12-468c-9083-1e651794b543 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.482230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.482651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.483044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.485530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] PATH_INFO: `/v3/projects/80cf767379b44ee29ed957abd7a092ee/users/3b666b034c30474ea526ce08f41d3d1d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.488730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cf767379b44ee29ed957abd7a092ee, user_id=3b666b034c30474ea526ce08f41d3d1d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.493065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13518750-9d26-408f-99ed-818e8b18bc42 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:25.526025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.529225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.529648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.530057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 904/1804] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:25 2022] PUT /identity/v3/projects/80cf767379b44ee29ed957abd7a092ee/users/3b666b034c30474ea526ce08f41d3d1d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:25.535458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760356b-7684-4158-b721-ab7830c3deec None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.535837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760356b-7684-4158-b721-ab7830c3deec None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.536143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760356b-7684-4158-b721-ab7830c3deec None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.540582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 905/1805] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:44:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:25.594313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.594602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.594929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.617669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] MFA Rules not processed for user `3b666b034c30474ea526ce08f41d3d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:25.619572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:25.640793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:25.642711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:25.653804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:25.741488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 901/1806] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:25.749170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:25.753919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:25.822537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 906/1807] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:44:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:25.927535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c6ff5-9caa-4652-a527-36c5d7f3a038 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:25.945672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:25.946333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:25.946660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:25.946957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:25.970087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:25.972975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69065d7e-a569-4127-b1f4-64f2da5b2dba service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:26.016702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 902/1808] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:26.353675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:26.458859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:26.524423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16abbf-0fa4-46e8-bd0b-bb930ae30b3f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:26.563318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:26.564022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:26.564299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:26.565150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] PATH_INFO: `/v3/users/aa14a82dac5c4571aec7713760e3eb74` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:26.568874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa14a82dac5c4571aec7713760e3eb74)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:26.571160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:26.743124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa14a82dac5c4571aec7713760e3eb74'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:26.750270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa14a82dac5c4571aec7713760e3eb74'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:26.771086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa14a82dac5c4571aec7713760e3eb74'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:26.849673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa14a82dac5c4571aec7713760e3eb74'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:26.870743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa14a82dac5c4571aec7713760e3eb74'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:26.891406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:26.892017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:26.892180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:26.896107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 907/1809] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:26 2022] DELETE /identity/v3/users/aa14a82dac5c4571aec7713760e3eb74 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:26.959109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:26.960956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:27.169526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 903/1810] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:27.188544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:27.192903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:27.365932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c1333-b09e-43fd-98d5-eafc75113501 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:27.378829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:27.379605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:27.381376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:27.381814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:27.399296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:27.401187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:27.437787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 908/1811] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:28.310278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:28.313503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:28.539250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:28.555165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04414-79c1-495e-9de2-097c455e7f7b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:28.574830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:28.576203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:28.576782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:28.577276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:28.580818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:28.623568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:28.630220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f6b80-cee5-4c7a-b71e-9f223934db97 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:28.672862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 904/1812] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:29.342542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.344556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:29.373199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb21a8f-aa6e-4157-81c3-1af5fedca7ff service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.385319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.385943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.386211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.386483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] PATH_INFO: `/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.389867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bff3bc2130348fb8bfa44b3214e7b08)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.392072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.490460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bff3bc2130348fb8bfa44b3214e7b08', 'request_id': 'req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:29.493141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:29.499512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bff3bc2130348fb8bfa44b3214e7b08', 'request_id': 'req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:29.524123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bff3bc2130348fb8bfa44b3214e7b08', 'request_id': 'req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:29.570946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] The token cache is being invalidate because project 3bff3bc2130348fb8bfa44b3214e7b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:29.572370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:29.573483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:29.585591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.586498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.586977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.612420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 909/1813] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:29 2022] DELETE /identity/v3/projects/3bff3bc2130348fb8bfa44b3214e7b08 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:29.625000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.626149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:29.656652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:29.665886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:29.861296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb295704-19a4-4ca0-ab94-4e06fcdeff8c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:29.875397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:29.876100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:29.909079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:29.911130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] PATH_INFO: `/v3/projects/cc0b8fdda0ac4147912f56b70030cc2c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:29.914208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0b8fdda0ac4147912f56b70030cc2c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:29.919353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:29.944056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 905/1814] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:29.951013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:29.955324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.018437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e567-8f66-4f11-8217-04c598f34a60 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:30.053314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0b8fdda0ac4147912f56b70030cc2c', 'request_id': 'req-dd52ddee-f9f5-42e7-bcca-567cb13867ac'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.069321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0b8fdda0ac4147912f56b70030cc2c', 'request_id': 'req-dd52ddee-f9f5-42e7-bcca-567cb13867ac'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.089136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0b8fdda0ac4147912f56b70030cc2c', 'request_id': 'req-dd52ddee-f9f5-42e7-bcca-567cb13867ac'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.119196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] The token cache is being invalidate because project cc0b8fdda0ac4147912f56b70030cc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:30.119496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.124092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dd52ddee-f9f5-42e7-bcca-567cb13867ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.126799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 910/1815] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:29 2022] DELETE /identity/v3/projects/cc0b8fdda0ac4147912f56b70030cc2c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:30.133302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.133586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.133938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.186723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:30.188007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.242510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:30.244998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.246436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.247371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] PATH_INFO: `/v3/projects/514b688eb13342efb4bf30f49b782d27` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.253931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=514b688eb13342efb4bf30f49b782d27)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:30.256817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:30.372175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 911/1816] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:30.376749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:30.380026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.407451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b65f30-f265-4ccd-a7c8-caf3b8f90da1 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:30.424511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:30.445603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514b688eb13342efb4bf30f49b782d27', 'request_id': 'req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.461365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514b688eb13342efb4bf30f49b782d27', 'request_id': 'req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.476151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514b688eb13342efb4bf30f49b782d27', 'request_id': 'req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.501619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] The token cache is being invalidate because project 514b688eb13342efb4bf30f49b782d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:30.502560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.503321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.511378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 906/1817] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:29 2022] DELETE /identity/v3/projects/514b688eb13342efb4bf30f49b782d27 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:30.513922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:30.516519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.549602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:30.637262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:30.638288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.640414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.642509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] PATH_INFO: `/v3/users/3b666b034c30474ea526ce08f41d3d1d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.648348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b666b034c30474ea526ce08f41d3d1d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:30.650201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352648-4fe5-44a0-a7af-c99aafb9cf1e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:30.654291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:30.663889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:30.666300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.666580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.667455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.669821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:30.669821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:30.676168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:30.717803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 907/1818] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:30.719011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:30.721514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.753438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b666b034c30474ea526ce08f41d3d1d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.757100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b666b034c30474ea526ce08f41d3d1d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.758722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2f62-2581-4f9c-b169-ebcd89cdba8f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:30.767097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:30.770302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:30.770502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b666b034c30474ea526ce08f41d3d1d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.771229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:30.771718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] PATH_INFO: `/v3/users/d66febf8ce644a798f73e7b208c879f2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:30.773872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66febf8ce644a798f73e7b208c879f2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:30.777489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:30.790960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b666b034c30474ea526ce08f41d3d1d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.807746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b666b034c30474ea526ce08f41d3d1d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.826048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 912/1819] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:30 2022] DELETE /identity/v3/users/3b666b034c30474ea526ce08f41d3d1d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:30.828361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:30.832370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:30.924310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66febf8ce644a798f73e7b208c879f2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.936397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66febf8ce644a798f73e7b208c879f2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.937937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66febf8ce644a798f73e7b208c879f2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.938850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66febf8ce644a798f73e7b208c879f2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:30.992166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66febf8ce644a798f73e7b208c879f2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:31.058906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 908/1820] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:30 2022] DELETE /identity/v3/users/d66febf8ce644a798f73e7b208c879f2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:31.109734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4df17-d1d4-49dc-a5b1-4f2783a6fa5a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:31.221735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:31.323804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:31.327506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:31.329677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:31.330038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:31.331649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:31.348401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:31.492278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 913/1821] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:30 2022] POST /identity/v3/projects => generated 383 bytes in 666 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:31.496135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:31.504285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:31.552037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeae06-b515-456c-b5a1-449506453985 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:31.734859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:31.737749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:31.741253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:31.742060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:31.743630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:31.746784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0ddde-0257-44a9-8e90-81c29fe7ee7f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:31.818844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:31.822098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 909/1822] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:31 2022] POST /identity/v3/users => generated 292 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:31.843424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d03f-1f22-4b3f-a7e3-46305ace527e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:31.855644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b97-43e0-4509-883e-246a3f0bf533 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:31.855904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b97-43e0-4509-883e-246a3f0bf533 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:31.856916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960b97-43e0-4509-883e-246a3f0bf533 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:31.860119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 910/1823] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:44:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:44:31.876264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:31.877684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:31.878169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:31.878598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:31.879384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:31.881224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:31.913487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 914/1824] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:31.920177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960b97-43e0-4509-883e-246a3f0bf533 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:31.953885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960b97-43e0-4509-883e-246a3f0bf533 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:31.990883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:31.992005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:31.992640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:31.993162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:31.995511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.003244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aed04c-b7d8-4d9a-a320-e7eb61b463fe admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.086348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 911/1825] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:32.091299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.117254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3933c-02e3-4d2a-9f29-5dba116769a1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.146803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.149272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.149272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.149272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] PATH_INFO: `/v3/projects/4334a3369d054f3c8e867fb27221204d/users/e0533625c4b54e2bae226ad96caf9201/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.198027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4334a3369d054f3c8e867fb27221204d, user_id=e0533625c4b54e2bae226ad96caf9201, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.201882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13220f8-b6d9-40ad-8e62-a9a2e36455fd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.235699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.238108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.238646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.269682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 915/1826] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:32 2022] PUT /identity/v3/projects/4334a3369d054f3c8e867fb27221204d/users/e0533625c4b54e2bae226ad96caf9201/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:32.275642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:32.280404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.282061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.282533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.336327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:32.340695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:32.383577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] MFA Rules not processed for user `e0533625c4b54e2bae226ad96caf9201`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:32.397282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:32.605019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 916/1827] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:32.606257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.608891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:32.610740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 912/1828] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:32.612864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.795933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d8daf-dfb1-464e-a6b8-826151f07c7e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.798272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f149-a34b-49f1-a4b4-5ade7d771a6d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:32.813830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.816923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.817425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.818289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:32.818716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] PATH_INFO: `/v3/projects/80cf767379b44ee29ed957abd7a092ee` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.820825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:32.821960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:32.822195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cf767379b44ee29ed957abd7a092ee)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.822634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:32.824983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:32.828076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.828801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:32.884150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:32.892220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 913/1829] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:32 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:32.899359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:32.952078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cf767379b44ee29ed957abd7a092ee', 'request_id': 'req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:32.962369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cf767379b44ee29ed957abd7a092ee', 'request_id': 'req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:32.975722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cf767379b44ee29ed957abd7a092ee', 'request_id': 'req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.012476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] The token cache is being invalidate because project 80cf767379b44ee29ed957abd7a092ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:33.013071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.014945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.023346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 917/1830] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:32 2022] DELETE /identity/v3/projects/80cf767379b44ee29ed957abd7a092ee => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:33.025610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.029159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.075055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff6b5a-01fa-4804-9bee-dee4ed386969 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.121998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:33.264330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.267227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.267584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.268528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.271447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.275896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ad48-fbd9-4ed2-946f-51fdf07551da admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.304586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc304-ac99-4b6d-b2de-c6cd2899ef2c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.318346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.319936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.321210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.322225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] PATH_INFO: `/v3/users/e4a468edae49477c945394b57e0fca76` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.325825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a468edae49477c945394b57e0fca76)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.329468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 914/1831] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:32 2022] POST /identity/v3/users => generated 297 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:33.329771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.330234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.332074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.338917 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.367754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:33.369251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.388089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 915/1832] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:33.389035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.390771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.496416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a468edae49477c945394b57e0fca76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.497139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a468edae49477c945394b57e0fca76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.512067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a468edae49477c945394b57e0fca76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.532546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a468edae49477c945394b57e0fca76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.556360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a468edae49477c945394b57e0fca76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:33.573326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 918/1833] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:33 2022] DELETE /identity/v3/users/e4a468edae49477c945394b57e0fca76 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:33.573326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.573326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.619905 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4a4b8-5ff9-4041-bae1-720496134078 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.621702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:33.678442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981fa0-ab17-464e-b628-25d9cefbfa97 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.685085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.686246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.687113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.687688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.689072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.691350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721e565-0e99-44c6-9604-247aeeae27cd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.707195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 919/1834] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:33.709005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a54d-922a-48b3-b6ee-0317fc22f009 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.709525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a54d-922a-48b3-b6ee-0317fc22f009 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.710095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40a54d-922a-48b3-b6ee-0317fc22f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.749775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-af40a54d-922a-48b3-b6ee-0317fc22f009 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:33.751190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-af40a54d-922a-48b3-b6ee-0317fc22f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.773433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 920/1835] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:33.780264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.781367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.784418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.795405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.796150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.796454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.796937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.804669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.834040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.835784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.857450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:33.859606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:33.861123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 916/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:33.871767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.886204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 921/1837] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:33.887282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.901554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874e315-187a-4fcc-916a-c077f62701fb None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.907393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d884e6-21c3-4690-807e-a70875652662 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.907615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.908931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.909310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.909810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.910577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:33.911049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.912748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.930346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 922/1838] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:33.930708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.931545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:33.931815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.932333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.932789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] PATH_INFO: `/v3/projects/83414f79df8349ccbb7ef2eaf5d39133/users/f681b34eeb1c442cac7d1acab8dc40dc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.948345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6d6b4-869b-4754-825a-d39de4e34a3d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:33.963413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:33.964040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:33.964347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:33.964608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:33.965263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.967336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:33.989178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] RBAC: Authorizing `identity:create_grant(project_id=83414f79df8349ccbb7ef2eaf5d39133, user_id=f681b34eeb1c442cac7d1acab8dc40dc, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:33.992169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.023914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 917/1839] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:33 2022] PUT /identity/v3/projects/83414f79df8349ccbb7ef2eaf5d39133/users/f681b34eeb1c442cac7d1acab8dc40dc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:34.025115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.027892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.034968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 923/1840] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:33 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:34.036642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.038816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.048822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.121389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86859515-2d7d-4c18-b292-7160640708da admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.122349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb153f65-c7bc-4543-9eab-059019164a8c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.127479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.128486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.128796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.129079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.196663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.197182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.197507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.198657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] PATH_INFO: `/v3/projects/27a8e3c1ddef4056826ac80363260b34` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.199094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a8e3c1ddef4056826ac80363260b34)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.201239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.215937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.218404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.231484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 924/1841] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:34.232273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.242246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06353-ed2b-4213-a18e-80c785d34af9 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.248853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.249609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.249955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.250230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.251286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.253487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.268892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 925/1842] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:34.268892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.280886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d185b-0a0b-448d-bcb0-842fdf14bd35 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.282497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a8e3c1ddef4056826ac80363260b34', 'request_id': 'req-950807ae-2106-4b36-a90b-1e37e12ee7c7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:34.292245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a8e3c1ddef4056826ac80363260b34', 'request_id': 'req-950807ae-2106-4b36-a90b-1e37e12ee7c7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:34.304075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.307635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a8e3c1ddef4056826ac80363260b34', 'request_id': 'req-950807ae-2106-4b36-a90b-1e37e12ee7c7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:34.328587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] The token cache is being invalidate because project 27a8e3c1ddef4056826ac80363260b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:34.329096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:34.329968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:34.334032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 918/1843] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:34 2022] DELETE /identity/v3/projects/27a8e3c1ddef4056826ac80363260b34 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:34.335236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.338828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.387417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.388041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.388320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.388592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.389335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.391245 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21e4c7-1947-443c-9648-0773ce2c1672 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.417969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 926/1844] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:34.419264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.419552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.419828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.430164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.445481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:34.446728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.456674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 927/1845] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:34.457730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.459258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.461880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950807ae-2106-4b36-a90b-1e37e12ee7c7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.472210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189055eb-0835-4ece-bfca-1ad3c7093f59 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.474646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.475690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.477049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.477183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.477905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.478177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.478625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.479062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] PATH_INFO: `/v3/projects/83414f79df8349ccbb7ef2eaf5d39133/users/f681b34eeb1c442cac7d1acab8dc40dc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.479314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.480951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3d8c6-9758-4337-844d-9f2d6f03327e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.481816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83414f79df8349ccbb7ef2eaf5d39133, user_id=f681b34eeb1c442cac7d1acab8dc40dc, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.485089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.495708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 928/1846] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:34.495708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049dd3-a534-497c-8690-4f7e4b097b1a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.495708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049dd3-a534-497c-8690-4f7e4b097b1a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.495708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049dd3-a534-497c-8690-4f7e4b097b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.504650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 919/1847] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:34 2022] PUT /identity/v3/projects/83414f79df8349ccbb7ef2eaf5d39133/users/f681b34eeb1c442cac7d1acab8dc40dc/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:34.506098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.521090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b1049dd3-a534-497c-8690-4f7e4b097b1a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:34.522631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b1049dd3-a534-497c-8690-4f7e4b097b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.592666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432959a2-086d-4eb0-affa-a365613da88a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.599791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.600654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.601131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.601407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.602704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.605073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.605204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 929/1848] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:34.606367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7bac-0b70-43ef-a0f8-501f2cc70d1c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.606751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7bac-0b70-43ef-a0f8-501f2cc70d1c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.607254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7bac-0b70-43ef-a0f8-501f2cc70d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.621574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 920/1849] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:34.621574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.633617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c537-6888-4446-b3bb-e21f37b4c248 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.640890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.642058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-05da7bac-0b70-43ef-a0f8-501f2cc70d1c None None] MFA Rules not processed for user `f681b34eeb1c442cac7d1acab8dc40dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:34.642607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.642607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.642788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.643518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:34.643857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.644015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-05da7bac-0b70-43ef-a0f8-501f2cc70d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.645554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.661523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 921/1850] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:34.662652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.686125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b15277-c841-496d-8a77-bbfe85d4701c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.695285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.696363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.696644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.696967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] PATH_INFO: `/v3/projects/4765f4b93d78498ea2190f7d283cfa5a/users/fe13f06fc81f4614ba8f6d12a1be5579/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.714345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4765f4b93d78498ea2190f7d283cfa5a, user_id=fe13f06fc81f4614ba8f6d12a1be5579, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.717479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.745963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 922/1851] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:34 2022] PUT /identity/v3/projects/4765f4b93d78498ea2190f7d283cfa5a/users/fe13f06fc81f4614ba8f6d12a1be5579/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:34.745963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.760751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 930/1852] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:34.768018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.768633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.769003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.804612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.817193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] MFA Rules not processed for user `fe13f06fc81f4614ba8f6d12a1be5579`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:34.819465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.850623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02d503-0137-435a-ab2a-cd3483fdcc79 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:34.855853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:34.856739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:34.857157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:34.857492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:34.858427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:34.861490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:34.916746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 923/1853] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:34.920683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.924133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.958848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 931/1854] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:34.963495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:34.965104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:34.979115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:34.981377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5399e-b0db-403c-a12a-d06916003c55 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.013121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a6708-82a9-4c0f-8de1-4255656842cf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.016942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.018258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.018633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.018999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.043217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.044153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.044436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.044713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] PATH_INFO: `/v3/projects/661b707760d84784b2c1921738132f43` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.046039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=661b707760d84784b2c1921738132f43)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.047966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.096942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.098534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.107487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661b707760d84784b2c1921738132f43', 'request_id': 'req-b6de2866-65a5-41ba-938e-0b663b5fd94d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.109339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 924/1855] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:35.113768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.116434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661b707760d84784b2c1921738132f43', 'request_id': 'req-b6de2866-65a5-41ba-938e-0b663b5fd94d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.125648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661b707760d84784b2c1921738132f43', 'request_id': 'req-b6de2866-65a5-41ba-938e-0b663b5fd94d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.129008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca448-66ea-4f83-839f-53ba5406096e service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.146001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] The token cache is being invalidate because project 661b707760d84784b2c1921738132f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:35.146244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.146981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.148813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 932/1856] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:34 2022] DELETE /identity/v3/projects/661b707760d84784b2c1921738132f43 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:35.149509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.150934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.197146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:35.203333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.203966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.204248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.204531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.206012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.208338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.249821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2866-65a5-41ba-938e-0b663b5fd94d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.255385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 925/1857] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:35 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:35.256370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.261559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.261710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.262316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.263312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.263680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.264431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.266581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.277491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebfc23-831b-41d3-a170-337799e49dbf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.285445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.286119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.286401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.286738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] PATH_INFO: `/v3/users/afba3e5b1bbe48d49e865e3f81f90b80` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.288243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afba3e5b1bbe48d49e865e3f81f90b80)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.290774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.300892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 933/1858] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:35 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:35.300892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.303074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.356999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afba3e5b1bbe48d49e865e3f81f90b80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.367070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afba3e5b1bbe48d49e865e3f81f90b80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.368077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afba3e5b1bbe48d49e865e3f81f90b80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.368983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afba3e5b1bbe48d49e865e3f81f90b80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.370366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bded67-5b5b-4ec7-9f50-e625fc6a4c1b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.374242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.374931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.375278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.375619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.378196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.382391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:35.387629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afba3e5b1bbe48d49e865e3f81f90b80'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:35.408882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 926/1859] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:35 2022] DELETE /identity/v3/users/afba3e5b1bbe48d49e865e3f81f90b80 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:35.411724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.413262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.485954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.488411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.498506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bca657-ee8a-49c8-a4a5-2812d45106d6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.499123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 934/1860] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:35.500553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.503587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.505605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.506451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.506733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.507047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.507787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.509557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.522305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 927/1861] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:35.527031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.544451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2c193-09c2-4c9f-967c-e1de39a77efd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.559522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.562031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.562383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.565575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.566685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.569425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.608303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 928/1862] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:35.618634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.638463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929c83-a80b-4324-a622-2979f26c9aed admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.646148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a606cea-5332-43b6-8193-c5a72c48e7a5 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.653661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.653947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.654226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.654494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] PATH_INFO: `/v3/projects/f5472d7e313746eda4a5c0f7a2a10098/users/a489d11ccb544fb7bbd32e8b27838aa6/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.657469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.657794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.658606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.659261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.660220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.670807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.694992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5472d7e313746eda4a5c0f7a2a10098, user_id=a489d11ccb544fb7bbd32e8b27838aa6, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.699886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6621550-5284-482a-8f1f-9201d9933b06 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.707669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:35.719803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 935/1863] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:35 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:35.724785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.732978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 929/1864] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:35 2022] PUT /identity/v3/projects/f5472d7e313746eda4a5c0f7a2a10098/users/a489d11ccb544fb7bbd32e8b27838aa6/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:35.747356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.748022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.748314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.755707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fe96-7f23-4c84-b43a-d478e7081500 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.806198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] MFA Rules not processed for user `a489d11ccb544fb7bbd32e8b27838aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:35.812785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:35.867316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.868083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.868376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.868708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.869422 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.870976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.889026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 936/1865] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:35.890551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.903279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec00a8-3bf2-45cc-85f5-6f50004cc072 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:35.917210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:35.917965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:35.919105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:35.919105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] PATH_INFO: `/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec/users/9664a7c612fe466c96e4721efa0683c7/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:35.957872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f89936751d4f6c9ea7c0aedf7065ec, user_id=9664a7c612fe466c96e4721efa0683c7, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:35.961089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:35.976916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 930/1866] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:35.984067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.992491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 937/1867] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:35 2022] PUT /identity/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec/users/9664a7c612fe466c96e4721efa0683c7/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:35.993577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:35.999577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582546f-919a-4b27-8d6c-c6c12a96c5a4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.055303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:36.115761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37bb9-57d1-42e9-8b1e-7d1b40d2c2b8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.122140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.122382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.122487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.122594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.122848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.123358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.123519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.123925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.124174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.125033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.125439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.128223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.144568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 938/1868] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:36.149099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.162180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0ac14-65c9-4af7-b275-9c8769f3579d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.167367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 931/1869] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:35 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:36.171835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.172708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.173177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.174179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.174383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] PATH_INFO: `/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec/users/9664a7c612fe466c96e4721efa0683c7/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.176698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f89936751d4f6c9ea7c0aedf7065ec, user_id=9664a7c612fe466c96e4721efa0683c7, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.179581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc702ce4-3fd4-4039-b3c7-ebc16355d949 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.192323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 939/1870] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:36 2022] PUT /identity/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec/users/9664a7c612fe466c96e4721efa0683c7/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:36.203763 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.204111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.204462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.235066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] MFA Rules not processed for user `9664a7c612fe466c96e4721efa0683c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:36.237412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.273447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0997e29-937a-48bd-937a-59198c3c5e4e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.288700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:36.325102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 940/1871] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:36.340173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.341829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.349792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.351912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.352199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.352491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.354026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.356008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.382965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 932/1872] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:36.388290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.403084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d335-ea4e-445b-827a-bcca991bc311 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.409018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.409725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.410102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.410473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.411239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.413008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.427382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 933/1873] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:36.428494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.428796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e2f5-ae60-4c4f-8d9d-02896aaebf20 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.432394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.433036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.433319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.433596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.445368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.446721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.450461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441cf3-6dd5-4580-b646-c5cadcc6777f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.456433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.457577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.457952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.458328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] PATH_INFO: `/v3/projects/fc3eb005d48c47ff838876fe05e75b6f/users/9e79202ab057425f85df36684d5709c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.461254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 941/1874] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:36.462129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.463792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.502830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86807d55-463e-4e0d-988c-3aeb6ee7ece6 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.518909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.519826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.520667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.521303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] PATH_INFO: `/v3/projects/691b48da922a435fa12e2c2313a6e241` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.522831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691b48da922a435fa12e2c2313a6e241)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.525487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.538256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3eb005d48c47ff838876fe05e75b6f, user_id=9e79202ab057425f85df36684d5709c5, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.542391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.565144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 934/1875] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:36 2022] PUT /identity/v3/projects/fc3eb005d48c47ff838876fe05e75b6f/users/9e79202ab057425f85df36684d5709c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:36.569100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.597217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:36.604042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691b48da922a435fa12e2c2313a6e241', 'request_id': 'req-7a39db55-63b0-4056-951d-5f9152b315f7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:36.611448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691b48da922a435fa12e2c2313a6e241', 'request_id': 'req-7a39db55-63b0-4056-951d-5f9152b315f7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:36.630405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691b48da922a435fa12e2c2313a6e241', 'request_id': 'req-7a39db55-63b0-4056-951d-5f9152b315f7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:36.648976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] The token cache is being invalidate because project 691b48da922a435fa12e2c2313a6e241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:36.649567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:36.650221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:36.657030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 942/1876] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:36 2022] DELETE /identity/v3/projects/691b48da922a435fa12e2c2313a6e241 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:36.657030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.657549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.673006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38698e38-685d-470e-8975-1a7c275b1f87 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.738790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39db55-63b0-4056-951d-5f9152b315f7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.743763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.744470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.744777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.745107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.745634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61480415-b63b-4661-9048-79f611884742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.745819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.746779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480415-b63b-4661-9048-79f611884742 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.747339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480415-b63b-4661-9048-79f611884742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.747675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0690a-14e9-4d30-ae24-b5914cfc8ad3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.747785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61480415-b63b-4661-9048-79f611884742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.750962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-61480415-b63b-4661-9048-79f611884742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.761659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 935/1877] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:36.764529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.764866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.765151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.792331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:36.796395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:36.797690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.820595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 936/1878] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:36.820595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:36.820595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.830594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42c0ad-0cfb-44d4-befc-02168f1ed9e8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:36.836120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:36.837123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.837504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.837875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] PATH_INFO: `/v3/projects/fc3eb005d48c47ff838876fe05e75b6f/users/9e79202ab057425f85df36684d5709c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.840156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3eb005d48c47ff838876fe05e75b6f, user_id=9e79202ab057425f85df36684d5709c5, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.843558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afefe84-66c4-4151-89c8-7334d57a1d65 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.855398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 937/1879] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:36 2022] PUT /identity/v3/projects/fc3eb005d48c47ff838876fe05e75b6f/users/9e79202ab057425f85df36684d5709c5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:36.858921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61480415-b63b-4661-9048-79f611884742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:36.861704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61480415-b63b-4661-9048-79f611884742 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:36.863385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce82289-bd71-4382-924d-e291175abab6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.863821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce82289-bd71-4382-924d-e291175abab6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.864397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce82289-bd71-4382-924d-e291175abab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.873568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 943/1880] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:36.886083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:36.886369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:36.886635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:36.913918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bce82289-bd71-4382-924d-e291175abab6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:36.915146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bce82289-bd71-4382-924d-e291175abab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:36.933805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] MFA Rules not processed for user `9e79202ab057425f85df36684d5709c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:36.935004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:37.036344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 944/1881] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:37.062282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.064210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:37.068743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 938/1882] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:37.074388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce82289-bd71-4382-924d-e291175abab6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.090262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce82289-bd71-4382-924d-e291175abab6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.097110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.097955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.099074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.099392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.100515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:37.100515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.103496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.125468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 939/1883] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:37.128066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.150165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08cd80-e594-4651-9d27-19b0f72cd86e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.159293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.160287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.160562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.160880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.161542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.165996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.187411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15b6f-0640-41c1-8aff-49b735b4621f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.194445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.201671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.203570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.204986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 940/1884] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:37 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:37.209388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.210360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.217770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:37.233116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.235372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.262289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 945/1885] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:37.355565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d233b-e422-47d4-8d3e-2854c7200277 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.363529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.364920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.365405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.365959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.368057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.370820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.435762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 941/1886] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:37 2022] POST /identity/v3/users => generated 282 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:37.439515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.462878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a85e9-1262-4e0c-9694-c8b35cce688e service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.487049 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.488094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.488374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.488656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.489543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.491216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.508604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 946/1887] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:37.509446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.521834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1df02c-e778-4662-b089-79f86af282a4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.528112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.528929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.529277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.529614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.530379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.532353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5d571-84ea-485b-881c-1565efea3fbb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.555412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.556089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 942/1888] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:37.567703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1535b-d9f6-4e97-9586-eaf64f4d30fc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.573353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.574393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.574829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.575329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] PATH_INFO: `/v3/projects/64746e6f9c1e43859e79883be7121dcc/users/a70046e5d4d4488eb6e1ab6f1c554f95/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.604255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64746e6f9c1e43859e79883be7121dcc, user_id=a70046e5d4d4488eb6e1ab6f1c554f95, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.607606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.637130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 947/1889] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:37 2022] PUT /identity/v3/projects/64746e6f9c1e43859e79883be7121dcc/users/a70046e5d4d4488eb6e1ab6f1c554f95/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:37.655758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.656402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.656962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.696880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] MFA Rules not processed for user `a70046e5d4d4488eb6e1ab6f1c554f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:37.698428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:37.768214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 943/1890] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:37.773590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.790295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:37.872968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613723e-c63f-4f02-84fe-6d5475269e30 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:37.879425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:37.880260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:37.880751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:37.881106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:37.881880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:37.884033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:37.927799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 948/1891] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:37 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:37.928783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:37.945934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce281b9-bb92-4475-9e4d-0e09c04d9561 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.028649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.029404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.030414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.030567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.031279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.034476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.067056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 944/1892] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:37 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:38.068358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.083736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897705ac-5ab1-4e95-a2da-b7912b24c536 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.085145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.089636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.090336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.090605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.091523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.091788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.092180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.094277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.100639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c2ec9-94f6-4e2b-814b-01dbaedbeec6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.107749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.108317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 949/1893] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:38.108500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.109116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.109333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] PATH_INFO: `/v3/users/a489d11ccb544fb7bbd32e8b27838aa6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.111039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a489d11ccb544fb7bbd32e8b27838aa6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.112729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.113413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.127313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92df111-ae52-4baf-88eb-227aa8a25834 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.134086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.134859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.135225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.135568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] PATH_INFO: `/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0/users/157a04ff06de4c80ae1e28d86e5c566c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.153912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62b9c21f63f483ca2c94f8bd6241fa0, user_id=157a04ff06de4c80ae1e28d86e5c566c, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.156883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.171644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a489d11ccb544fb7bbd32e8b27838aa6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.172465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 950/1894] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:38 2022] PUT /identity/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0/users/157a04ff06de4c80ae1e28d86e5c566c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:38.177011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.181177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a489d11ccb544fb7bbd32e8b27838aa6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.181868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a489d11ccb544fb7bbd32e8b27838aa6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.182545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a489d11ccb544fb7bbd32e8b27838aa6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.195574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b9510e25-7096-4683-8652-4351f4f6f913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a489d11ccb544fb7bbd32e8b27838aa6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.212789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 945/1895] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:38 2022] DELETE /identity/v3/users/a489d11ccb544fb7bbd32e8b27838aa6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:38.214529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.214811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.215117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.234835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:38.236030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.243100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849ea19-dd80-4c2f-a8bb-33b1bbc1c0d4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.303698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 946/1896] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:38.310644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.311656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.311989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.312303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.313215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.315637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.316886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.318448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.330632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 951/1897] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:38.335721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.337654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.355199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8d2d-5b8e-4f3b-b17b-1fa852188783 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.359946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.360601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.360922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.361318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] PATH_INFO: `/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0/users/157a04ff06de4c80ae1e28d86e5c566c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.363395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62b9c21f63f483ca2c94f8bd6241fa0, user_id=157a04ff06de4c80ae1e28d86e5c566c, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.366124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa427221-3190-45e9-aa38-676cd6597dc2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.368777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.378930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 952/1898] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:38 2022] PUT /identity/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0/users/157a04ff06de4c80ae1e28d86e5c566c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:38.380527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f32e-06ac-4261-949f-32c1c037d9ea None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.389004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.389300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.389571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.425633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] MFA Rules not processed for user `157a04ff06de4c80ae1e28d86e5c566c`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:38.426893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.434334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:38.461142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.461772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.464486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.464486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.512795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 953/1899] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:38.524144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.526179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.557167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.558611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.570706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 947/1900] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:38.604287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609017fd-e571-4afc-85dc-15451ddb672f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.608600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.609362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.609709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.610051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.620156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.621802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.633680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 954/1901] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:38.697371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.699336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.714737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded5102-c05b-4d3e-a720-2d1da4399db7 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.720279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.722075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.722467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.722920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] PATH_INFO: `/v3/users/e0533625c4b54e2bae226ad96caf9201` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.724365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0533625c4b54e2bae226ad96caf9201)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.726940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.762978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.776020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cdd18-ecbb-46c5-b432-f37d101a2b82 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:38.782289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:38.784009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.784368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.785001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.798518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.847993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0533625c4b54e2bae226ad96caf9201'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.863026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0533625c4b54e2bae226ad96caf9201'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.863732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0533625c4b54e2bae226ad96caf9201'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.864649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0533625c4b54e2bae226ad96caf9201'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.888222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-87eb3ec7-84f7-4bc9-9669-a2a2a6542710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0533625c4b54e2bae226ad96caf9201'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:38.921592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 948/1902] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:38 2022] DELETE /identity/v3/users/e0533625c4b54e2bae226ad96caf9201 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:38.926582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:38.927426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:38.927785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:38.928076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:38.928442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:38.957436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:38.959130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 955/1903] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:38.959608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:38.985373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:38.995437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.018870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d477a-497f-49ed-955c-46e4d26f7315 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.056965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.061351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.097949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 949/1904] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:39.107801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.109270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.134153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.135018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.135402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.135783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] PATH_INFO: `/v3/projects/f5472d7e313746eda4a5c0f7a2a10098` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.137484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5472d7e313746eda4a5c0f7a2a10098)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.140885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.204489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d9e1-87f1-4317-93d5-4641007cc36d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.211102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.212011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.212496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.212956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.224645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.226912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.242603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 950/1905] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:39.243609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5472d7e313746eda4a5c0f7a2a10098', 'request_id': 'req-a014a453-1e89-49f9-b6b1-43c3a43c0c76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.250375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5472d7e313746eda4a5c0f7a2a10098', 'request_id': 'req-a014a453-1e89-49f9-b6b1-43c3a43c0c76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.268223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5472d7e313746eda4a5c0f7a2a10098', 'request_id': 'req-a014a453-1e89-49f9-b6b1-43c3a43c0c76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.285148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] The token cache is being invalidate because project f5472d7e313746eda4a5c0f7a2a10098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:39.286324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.287359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.292625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 956/1906] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:38 2022] DELETE /identity/v3/projects/f5472d7e313746eda4a5c0f7a2a10098 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:39.293512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.294934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.318315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73608a9-8f14-47d8-b14c-622f43359a37 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.405156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.405895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.406108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.406380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] PATH_INFO: `/v3/users/9e79202ab057425f85df36684d5709c5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.407526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e79202ab057425f85df36684d5709c5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.410050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.463896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e79202ab057425f85df36684d5709c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.472985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e79202ab057425f85df36684d5709c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.473958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e79202ab057425f85df36684d5709c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.474373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e79202ab057425f85df36684d5709c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.488296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e79202ab057425f85df36684d5709c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.500710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 951/1907] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:39 2022] DELETE /identity/v3/users/9e79202ab057425f85df36684d5709c5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:39.566154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.568381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.590428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014a453-1e89-49f9-b6b1-43c3a43c0c76 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.669093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.669802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.670144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.670839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] PATH_INFO: `/v3/projects/4334a3369d054f3c8e867fb27221204d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.672192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4334a3369d054f3c8e867fb27221204d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.674844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.726719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4334a3369d054f3c8e867fb27221204d', 'request_id': 'req-0adf5106-5b20-4ed2-87c3-8d754468a38e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.728890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.734977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4334a3369d054f3c8e867fb27221204d', 'request_id': 'req-0adf5106-5b20-4ed2-87c3-8d754468a38e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.744414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4334a3369d054f3c8e867fb27221204d', 'request_id': 'req-0adf5106-5b20-4ed2-87c3-8d754468a38e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.757025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] The token cache is being invalidate because project 4334a3369d054f3c8e867fb27221204d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:39.757308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.757979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.759492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 957/1908] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:39 2022] DELETE /identity/v3/projects/4334a3369d054f3c8e867fb27221204d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:39.763568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.765042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.778673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e54a-3fbb-41e0-a0fb-c8b8b6036c46 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.795783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:39.846425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.847058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.847697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.847697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] PATH_INFO: `/v3/users/f681b34eeb1c442cac7d1acab8dc40dc` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.848626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f681b34eeb1c442cac7d1acab8dc40dc)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.850595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.888922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:39.891256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:39.912014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f681b34eeb1c442cac7d1acab8dc40dc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.917112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf5106-5b20-4ed2-87c3-8d754468a38e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:39.924627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f681b34eeb1c442cac7d1acab8dc40dc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.925187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:39.925299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f681b34eeb1c442cac7d1acab8dc40dc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.925941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f681b34eeb1c442cac7d1acab8dc40dc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.926074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:39.926233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:39.926669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] PATH_INFO: `/v3/projects/fc3eb005d48c47ff838876fe05e75b6f` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:39.929436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3eb005d48c47ff838876fe05e75b6f)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:39.931056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:39.942895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-45da6e46-54ba-4dc1-b0fa-82693447ff94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f681b34eeb1c442cac7d1acab8dc40dc'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:39.961218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 952/1909] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:39 2022] DELETE /identity/v3/users/f681b34eeb1c442cac7d1acab8dc40dc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:40.010383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3eb005d48c47ff838876fe05e75b6f', 'request_id': 'req-d5e07340-8af2-4391-86d1-37c9e5e579e4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.029638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3eb005d48c47ff838876fe05e75b6f', 'request_id': 'req-d5e07340-8af2-4391-86d1-37c9e5e579e4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.056622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3eb005d48c47ff838876fe05e75b6f', 'request_id': 'req-d5e07340-8af2-4391-86d1-37c9e5e579e4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.072281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] The token cache is being invalidate because project fc3eb005d48c47ff838876fe05e75b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:40.072631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.073322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d5e07340-8af2-4391-86d1-37c9e5e579e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.074987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 958/1910] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:39 2022] DELETE /identity/v3/projects/fc3eb005d48c47ff838876fe05e75b6f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:40.080187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.080472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.081208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.115160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:40.116628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.235608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 953/1911] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:40.242301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.243112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.243903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.285119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:40.288379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.301393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 959/1912] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:40.302712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.314682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92538f0e-b2c9-48ce-b9d3-ed397710a1fc None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.333366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.334375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.334846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.335344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.336141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:40.336609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.339123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.343988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.348341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.359472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 954/1913] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:40.364881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.371693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0039f1-00f6-426b-b542-0311f7b3c73b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.380462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.381345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.381677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.382070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] PATH_INFO: `/v3/projects/83414f79df8349ccbb7ef2eaf5d39133` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.383530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=83414f79df8349ccbb7ef2eaf5d39133)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.385718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.411336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d6e94-8a35-4dd1-a12b-a8e1dc6cb715 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.427103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.427736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.428011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.440291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.441390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.443417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.490363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83414f79df8349ccbb7ef2eaf5d39133', 'request_id': 'req-80737059-3bc7-42db-a169-9c7aeee1bccf'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.498790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83414f79df8349ccbb7ef2eaf5d39133', 'request_id': 'req-80737059-3bc7-42db-a169-9c7aeee1bccf'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.513027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83414f79df8349ccbb7ef2eaf5d39133', 'request_id': 'req-80737059-3bc7-42db-a169-9c7aeee1bccf'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.520300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:40.530628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] The token cache is being invalidate because project 83414f79df8349ccbb7ef2eaf5d39133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:40.530928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.531605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80737059-3bc7-42db-a169-9c7aeee1bccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:40.536727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 960/1914] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:40 2022] DELETE /identity/v3/projects/83414f79df8349ccbb7ef2eaf5d39133 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:40.541265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 955/1915] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:40.542398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.542732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192360c6-bf6b-4eda-8066-bb247fe47927 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.543023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192360c6-bf6b-4eda-8066-bb247fe47927 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.543338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192360c6-bf6b-4eda-8066-bb247fe47927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.545160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.579017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-192360c6-bf6b-4eda-8066-bb247fe47927 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:40.582952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-192360c6-bf6b-4eda-8066-bb247fe47927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.650578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f4a1-cb88-46ea-ba5c-d4d43276c499 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.656302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.657259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.657550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.657824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.659116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.661470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:40.662514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.692306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 956/1916] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:40.696261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.720594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5456c5b-f1e6-449b-a7ed-9059be7f597b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.720718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 961/1917] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:40.725277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.725687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.726069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.726313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.727119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.727584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.728027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.728884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.730681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.745839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 957/1918] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:40.750928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.754161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:40.755486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.764501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a68a35-c2ec-44a4-b14e-a3bc101bf025 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.771605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.772217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.772639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.773130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.773772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.775794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.782928 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 962/1919] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:40.794060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.796772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 958/1920] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:40.801054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.804969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81063711-3b0d-4238-b27b-494463beb0b9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.811316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.812062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.812475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.813074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.814635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:40.815176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.816503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0350a04-ab32-42ac-a0df-cb0fd3597b92 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.817072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.822118 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.822960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.823383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.824108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] PATH_INFO: `/v3/projects/da23cd6cfc46429d9e92fd1bc33a2e1b/users/5e53febc27944339b4564eda1778a8c8/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.833296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 963/1921] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:40.842760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da23cd6cfc46429d9e92fd1bc33a2e1b, user_id=5e53febc27944339b4564eda1778a8c8, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.846463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033759c-3f72-4ca0-b654-700bf649d4dd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:40.847934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:40.863241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55048c-0f1b-4a73-9e5a-a331472c2a0d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:40.868958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 959/1922] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:40 2022] PUT /identity/v3/projects/da23cd6cfc46429d9e92fd1bc33a2e1b/users/5e53febc27944339b4564eda1778a8c8/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:40.878301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.878815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.879399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.963814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] MFA Rules not processed for user `5e53febc27944339b4564eda1778a8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:40.966253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:40.975541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:40.977453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:40.977839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:40.978400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:40.979238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:40.981323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.037212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 964/1923] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/projects => generated 409 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:41.040918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.076480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 960/1924] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:41.088518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.090100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:41.137200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:41.153326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138134f-ceed-43d7-92dd-15b96d8add03 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.158244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.158871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.159160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.159429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.160075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.162050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.165685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a44e73-f8e4-4549-8e33-4c1669195d59 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.187324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 965/1925] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:41 2022] POST /identity/v3/users => generated 305 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:41.192703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.203497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2690ff1-21eb-402c-9031-a6b532854533 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.209649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.210269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.210544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.211162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.212309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.213944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.225264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.225886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.226258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.226434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.226868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 966/1926] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:41.231231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.244015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd62cee-e038-4d1b-807b-2ea02cac886f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.249541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.250151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.250431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.250705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.251654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.253877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.266009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 967/1927] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:41.271128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.281920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9a26c-85a0-4749-b00d-e9ebaf8d124a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.287737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.289124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.289755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.290032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] PATH_INFO: `/v3/projects/e34ce53e054c46b082ff2670c2343833/users/0d7093dee282477cb203b84d30ac6161/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.304099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:41.307300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.308908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac3d2a-f008-44c9-8b7e-d5863f5359af service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.310450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e34ce53e054c46b082ff2670c2343833, user_id=0d7093dee282477cb203b84d30ac6161, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.314681 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.319527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 961/1928] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:41.335708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 968/1929] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:41 2022] PUT /identity/v3/projects/e34ce53e054c46b082ff2670c2343833/users/0d7093dee282477cb203b84d30ac6161/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:41.346998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.347269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.347541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.385937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] MFA Rules not processed for user `0d7093dee282477cb203b84d30ac6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:41.387306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:41.487785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 962/1930] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:41.492891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.600600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ab568-c499-4cf2-96fd-6718cf9e4a1d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.606778 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.607482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.607905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.608273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.610814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.614078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.724993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 969/1931] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:41 2022] POST /identity/v3/projects => generated 407 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:41.726219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.745842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100807de-0f86-4312-9db5-e9cc4bd6b798 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.815413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:41.870398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.871387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.871879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.872529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.873821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.876489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.917971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 963/1932] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:41 2022] POST /identity/v3/users => generated 310 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:41.920322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.933912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce8103-8e2e-4c6f-a792-dce1d0599efd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.940196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.940912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.941319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.941599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:41.942420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:41.944053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:41.960580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 970/1933] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:41.964914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:41.977828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0dca-e6e1-4c00-a7ca-057483261a6a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:41.984219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:41.984945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:41.985226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:41.985508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] PATH_INFO: `/v3/projects/6443bdd9f5d540429cb2d649952456c4/users/ba5600d2e26e4def904930219f7da36e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.007680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6443bdd9f5d540429cb2d649952456c4, user_id=ba5600d2e26e4def904930219f7da36e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.011670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.032781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 964/1934] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:41 2022] PUT /identity/v3/projects/6443bdd9f5d540429cb2d649952456c4/users/ba5600d2e26e4def904930219f7da36e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:42.038121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.064275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf550b-858e-4302-ae0f-f8358bca015a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.174501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.175189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.175462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.175793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.176448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.178561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be7a0-610f-4588-af0e-268bef802c40 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.191976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 971/1935] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:42.197028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.208468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6933-d6a3-42c6-801a-2d5020f201cb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.215494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.217184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.217594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.217975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] PATH_INFO: `/v3/projects/6443bdd9f5d540429cb2d649952456c4/users/ba5600d2e26e4def904930219f7da36e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.221490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6443bdd9f5d540429cb2d649952456c4, user_id=ba5600d2e26e4def904930219f7da36e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.224338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.236830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 965/1936] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:42 2022] PUT /identity/v3/projects/6443bdd9f5d540429cb2d649952456c4/users/ba5600d2e26e4def904930219f7da36e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:42.248143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.248424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.248700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.284394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] MFA Rules not processed for user `ba5600d2e26e4def904930219f7da36e`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:42.285793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:42.346741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.374363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 972/1937] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:42.388426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.460672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1393f8e-1f11-4aea-862e-dbde1dfd7545 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.465088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.465885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.466322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.466617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.481789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:42.483835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:42.498236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 966/1938] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:42.883334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.885418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:42.891049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:42.902864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df161-62d2-478c-add1-1956a376509c service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:42.910238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:42.911174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.911705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.912183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.002394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.003856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547ecf-ab6a-47d1-998d-8295c6626019 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.024809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f091624-54c6-436d-8240-d6442cdf2c69 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.026102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 967/1939] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:43.026412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.026412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.026412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.026412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] PATH_INFO: `/v3/users/fe13f06fc81f4614ba8f6d12a1be5579` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.026985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe13f06fc81f4614ba8f6d12a1be5579)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.026985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.118886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe13f06fc81f4614ba8f6d12a1be5579'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:43.145217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe13f06fc81f4614ba8f6d12a1be5579'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:43.171102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe13f06fc81f4614ba8f6d12a1be5579'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:43.208541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe13f06fc81f4614ba8f6d12a1be5579'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:43.229031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe13f06fc81f4614ba8f6d12a1be5579'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:43.262014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 973/1940] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:42 2022] DELETE /identity/v3/users/fe13f06fc81f4614ba8f6d12a1be5579 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:43.266195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.266784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.267085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.306892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:43.308879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.356010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.460215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 968/1941] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:43.467663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.469509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.550502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1484d95-f2a7-4658-a112-e052f20c2e52 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.554621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.555255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.556002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.556286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.579087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.581599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.594580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 974/1942] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:43.969903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.973585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:44.002324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ed026-7f53-462c-aa20-84a8f90a7c17 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:44.013534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:44.014616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:44.015129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:44.015421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] PATH_INFO: `/v3/projects/4765f4b93d78498ea2190f7d283cfa5a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:44.016787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4765f4b93d78498ea2190f7d283cfa5a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:44.020121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:44.122595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4765f4b93d78498ea2190f7d283cfa5a', 'request_id': 'req-5b224e3c-d5be-434c-b028-d1bd9cf3a020'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.133550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4765f4b93d78498ea2190f7d283cfa5a', 'request_id': 'req-5b224e3c-d5be-434c-b028-d1bd9cf3a020'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.147771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4765f4b93d78498ea2190f7d283cfa5a', 'request_id': 'req-5b224e3c-d5be-434c-b028-d1bd9cf3a020'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.171486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] The token cache is being invalidate because project 4765f4b93d78498ea2190f7d283cfa5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:44.171961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.172879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5b224e3c-d5be-434c-b028-d1bd9cf3a020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.175843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 969/1943] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:43 2022] DELETE /identity/v3/projects/4765f4b93d78498ea2190f7d283cfa5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:44.180447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:44.193586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4262-1cc4-4101-a754-39175c6cde9e service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:44.199114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:44.328120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:44.331643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:44.331944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:44.332505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] PATH_INFO: `/v3/users/9664a7c612fe466c96e4721efa0683c7` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:44.334896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9664a7c612fe466c96e4721efa0683c7)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:44.337538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:44.428353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9664a7c612fe466c96e4721efa0683c7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.429249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9664a7c612fe466c96e4721efa0683c7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.438129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973dc4-2133-4440-9acd-d43e097fbfdc None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:44.438697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973dc4-2133-4440-9acd-d43e097fbfdc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:44.438697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75973dc4-2133-4440-9acd-d43e097fbfdc None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:44.447309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9664a7c612fe466c96e4721efa0683c7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.447730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 970/1944] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:44:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:44.485070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9664a7c612fe466c96e4721efa0683c7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.489119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e622-3cae-4e6c-8649-352846cc5543 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:44.489405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e622-3cae-4e6c-8649-352846cc5543 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:44.489688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9e622-3cae-4e6c-8649-352846cc5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:44.522678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9664a7c612fe466c96e4721efa0683c7'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:44.537089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a0f9e622-3cae-4e6c-8649-352846cc5543 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:44.537980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 975/1945] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:44 2022] DELETE /identity/v3/users/9664a7c612fe466c96e4721efa0683c7 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:44.553573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a0f9e622-3cae-4e6c-8649-352846cc5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:44.763635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 971/1946] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:45.184226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:45.186876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:45.420027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b4278-f7a7-4fdd-bdb6-47c5688fe1d0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:45.438364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:45.441142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.441428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.442037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] PATH_INFO: `/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.444345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f89936751d4f6c9ea7c0aedf7065ec)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:45.446977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:45.516663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:45.561596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f89936751d4f6c9ea7c0aedf7065ec', 'request_id': 'req-fed7eb45-de9f-4d99-823c-8d9fa1476521'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:45.569228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f89936751d4f6c9ea7c0aedf7065ec', 'request_id': 'req-fed7eb45-de9f-4d99-823c-8d9fa1476521'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:45.578546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f89936751d4f6c9ea7c0aedf7065ec', 'request_id': 'req-fed7eb45-de9f-4d99-823c-8d9fa1476521'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:45.593758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] The token cache is being invalidate because project a2f89936751d4f6c9ea7c0aedf7065ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:45.594124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:45.594747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fed7eb45-de9f-4d99-823c-8d9fa1476521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:45.597269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 976/1947] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:45 2022] DELETE /identity/v3/projects/a2f89936751d4f6c9ea7c0aedf7065ec => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:45.602572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.603158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.603158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.625372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:45.626826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:45.685631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:45.725482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 972/1948] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:45.734768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.735090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.735386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.760953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:45.762871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:45.780337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 977/1949] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:45.785628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:45.799665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bdd0d-0f1d-4fb6-b1a2-c07881c518ba None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:45.807090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:45.807834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.808181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.808522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.809774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:45.809774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:45.811604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:45.828278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 973/1950] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:45.833291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:45.842962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb739d8-a579-491d-98d4-033c15049fe5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:45.848557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:45.849342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.849682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.849899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.850654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:45.853298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:45.890009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 978/1951] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:45 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:45.891495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:45.905226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8496-9d98-4f1f-b7ee-725133a1ec97 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:45.969644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:45.971249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:45.992257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:45.992915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:45.993194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:45.993454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:45.994169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:45.996687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.044786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 974/1952] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:45 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:46.051990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.066542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af07031-58c9-4ee8-a827-6aa08744eeca admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.073650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.074509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.074976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.075434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.076708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.078496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a7889-e72c-455a-9123-086cda6bae30 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.078870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.086725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.087629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.087977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.088368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.093694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:46.097149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 975/1953] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:46.101743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.133776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.136346 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97e523-7380-4c3e-af45-439d81daafe2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.145935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.146854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.147146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.147464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.149207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.150384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.151949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed441ab3-52e2-4008-baa0-6adad867ede5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.190579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 979/1954] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:46.211440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 976/1955] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:46.213995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.234754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56843bd6-7bb4-4679-bbe8-39dbdeddac5b service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.246848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.247539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.247814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.248088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] PATH_INFO: `/v3/projects/fa4147f85d614ce0a1b497c9d3ba8213/users/bf10b54fed10470cb10e2a440ef745ae/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.278519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4147f85d614ce0a1b497c9d3ba8213, user_id=bf10b54fed10470cb10e2a440ef745ae, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.285476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.313545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 980/1956] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:46 2022] PUT /identity/v3/projects/fa4147f85d614ce0a1b497c9d3ba8213/users/bf10b54fed10470cb10e2a440ef745ae/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:46.327345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011ced-0a84-4e62-af10-639608815632 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.327742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011ced-0a84-4e62-af10-639608815632 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.328281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22011ced-0a84-4e62-af10-639608815632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.397857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-22011ced-0a84-4e62-af10-639608815632 None None] MFA Rules not processed for user `bf10b54fed10470cb10e2a440ef745ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:46.399203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-22011ced-0a84-4e62-af10-639608815632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:46.586069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 977/1957] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:44:46.590738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.782324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:46.843144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb11743-fc73-40b2-baef-8d77ce4e45e1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.849274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.849931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.850279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.850485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.851218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.853785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:46.928987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 981/1958] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:46 2022] POST /identity/v3/projects => generated 379 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:46.929195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22011ced-0a84-4e62-af10-639608815632 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.947860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22011ced-0a84-4e62-af10-639608815632 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.004513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.028707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.031815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.113652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.114823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.114823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.114823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.115455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.125759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.167542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddd63-636c-406f-98b6-48ee71f7cbfb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.169027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 978/1959] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:46 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:47.170430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.174184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.175161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.175607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.175891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] PATH_INFO: `/v3/users/5e53febc27944339b4564eda1778a8c8` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.177288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e53febc27944339b4564eda1778a8c8)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.179421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.189673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3100f2-2473-4487-9c8d-6a25e469def8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.197864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.199346 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.199673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.200162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.201044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.205564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.224814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 979/1960] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:47.229826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.255852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082275f3-8f7c-4985-8bb0-d6b842807f83 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.260821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.261773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.262068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.262385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] PATH_INFO: `/v3/projects/8581c9cc2cf54908ab421bbf49c186d8/users/30767f62c9dc4ec399889b12d7f7b07a/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.269776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e53febc27944339b4564eda1778a8c8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.270562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e53febc27944339b4564eda1778a8c8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.288453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e53febc27944339b4564eda1778a8c8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.292932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8581c9cc2cf54908ab421bbf49c186d8, user_id=30767f62c9dc4ec399889b12d7f7b07a, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.295956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.311403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e53febc27944339b4564eda1778a8c8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.321581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 980/1961] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:47 2022] PUT /identity/v3/projects/8581c9cc2cf54908ab421bbf49c186d8/users/30767f62c9dc4ec399889b12d7f7b07a/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:47.323056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.325934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e53febc27944339b4564eda1778a8c8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.326109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.337653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 982/1962] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:47 2022] DELETE /identity/v3/users/5e53febc27944339b4564eda1778a8c8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:47.339026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.341549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.423021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.442786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df388e-1eaa-4354-a49c-453cd11f7187 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.446793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05f324-36c4-4e2b-a9ff-3078d999a2bd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.452023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.452634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.452905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.453230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.453389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.453637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.453869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] PATH_INFO: `/v3/users/a70046e5d4d4488eb6e1ab6f1c554f95` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.454352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.455708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70046e5d4d4488eb6e1ab6f1c554f95)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.456544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.458413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.458881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e11a25-d2be-4bee-aff9-e6cf24d7080a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.485161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 983/1963] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:47.488592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.489429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.490026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.518729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:47.520979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.528097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70046e5d4d4488eb6e1ab6f1c554f95'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.533376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 984/1964] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:47.534917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.543752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70046e5d4d4488eb6e1ab6f1c554f95'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.544938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70046e5d4d4488eb6e1ab6f1c554f95'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.546039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70046e5d4d4488eb6e1ab6f1c554f95'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.546159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252362b0-5180-48bd-8766-0d1d3b1e5a53 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.551355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.552039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.552328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.552587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] PATH_INFO: `/v3/projects/8581c9cc2cf54908ab421bbf49c186d8/users/30767f62c9dc4ec399889b12d7f7b07a/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.554682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8581c9cc2cf54908ab421bbf49c186d8, user_id=30767f62c9dc4ec399889b12d7f7b07a, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.557424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.568124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-182491dd-3485-46bb-b98f-c98927173d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70046e5d4d4488eb6e1ab6f1c554f95'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:47.574462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 985/1965] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:47 2022] PUT /identity/v3/projects/8581c9cc2cf54908ab421bbf49c186d8/users/30767f62c9dc4ec399889b12d7f7b07a/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:47.575423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.577212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.586797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.593257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 981/1966] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:47 2022] DELETE /identity/v3/users/a70046e5d4d4488eb6e1ab6f1c554f95 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:47.596138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042ad6-fb96-45de-bac8-e00aebe63a58 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.597246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042ad6-fb96-45de-bac8-e00aebe63a58 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.597946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042ad6-fb96-45de-bac8-e00aebe63a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.638924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-a4042ad6-fb96-45de-bac8-e00aebe63a58 None None] MFA Rules not processed for user `30767f62c9dc4ec399889b12d7f7b07a`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:47.640424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a4042ad6-fb96-45de-bac8-e00aebe63a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.663629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b29bd-bc35-4b63-b547-c1c281c460e5 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.722077 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.722706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.723046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.723456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.725606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.736396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 982/1967] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:47.738333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.738333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.738576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.765519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:47.766868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.839652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.839652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.854972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 986/1968] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:47.855678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.858034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.881014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 983/1969] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:47.891502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:47.898299 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:47.914560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e26284-0ac4-4124-86ff-fb1680189bc7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.918372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:47.920385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.921961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.923138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.923962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.936373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.941617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.947961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b88b-86db-49cc-a092-5eed9711cfee service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:47.952933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:47.953568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:47.953851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:47.954134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:47.963774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 984/1970] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:44:47.968623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:47.970968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.000306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 987/1971] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:48.553171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:48.554793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:48.575107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ca647-2d7a-4000-82d8-0a4be1f2583a service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.585069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.586277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.586634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.587515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] PATH_INFO: `/v3/projects/64746e6f9c1e43859e79883be7121dcc` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.589286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64746e6f9c1e43859e79883be7121dcc)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.598812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.676242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:48.681365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:48.700803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64746e6f9c1e43859e79883be7121dcc', 'request_id': 'req-765e7e1e-2a5e-42f3-80e7-efda281b6825'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.704225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb727e0-37c4-40d7-9bfd-91ec4bdb9d45 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.710106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64746e6f9c1e43859e79883be7121dcc', 'request_id': 'req-765e7e1e-2a5e-42f3-80e7-efda281b6825'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.726326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64746e6f9c1e43859e79883be7121dcc', 'request_id': 'req-765e7e1e-2a5e-42f3-80e7-efda281b6825'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.780837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:48.808607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] The token cache is being invalidate because project 64746e6f9c1e43859e79883be7121dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:48.808937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.811321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.832684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.832972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 985/1972] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:48 2022] DELETE /identity/v3/projects/64746e6f9c1e43859e79883be7121dcc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:48.835522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.835522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.836490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] PATH_INFO: `/v3/users/bf10b54fed10470cb10e2a440ef745ae` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.837025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf10b54fed10470cb10e2a440ef745ae)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.837862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:48.841114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.842003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:48.869679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e7e1e-2a5e-42f3-80e7-efda281b6825 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:48.880687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:48.881507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:48.881778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:48.882083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] PATH_INFO: `/v3/projects/da23cd6cfc46429d9e92fd1bc33a2e1b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:48.883811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da23cd6cfc46429d9e92fd1bc33a2e1b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:48.885951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:48.950897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf10b54fed10470cb10e2a440ef745ae'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.952452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf10b54fed10470cb10e2a440ef745ae'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.957066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da23cd6cfc46429d9e92fd1bc33a2e1b', 'request_id': 'req-60e68d5b-4624-40fe-899a-5622a3290715'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.964350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf10b54fed10470cb10e2a440ef745ae'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.965345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da23cd6cfc46429d9e92fd1bc33a2e1b', 'request_id': 'req-60e68d5b-4624-40fe-899a-5622a3290715'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.983372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da23cd6cfc46429d9e92fd1bc33a2e1b', 'request_id': 'req-60e68d5b-4624-40fe-899a-5622a3290715'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.994512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf10b54fed10470cb10e2a440ef745ae'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.998137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] The token cache is being invalidate because project da23cd6cfc46429d9e92fd1bc33a2e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:48.998660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:48.999355 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.002255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 986/1973] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:48 2022] DELETE /identity/v3/projects/da23cd6cfc46429d9e92fd1bc33a2e1b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:49.003529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.005703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.011854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-132fcda2-9968-4ef5-92db-41ec24178897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf10b54fed10470cb10e2a440ef745ae'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.021579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 988/1974] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:48 2022] DELETE /identity/v3/users/bf10b54fed10470cb10e2a440ef745ae => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:49.023205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3893-3457-4f83-8b9b-8f10f9289958 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.023491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3893-3457-4f83-8b9b-8f10f9289958 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.023765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3893-3457-4f83-8b9b-8f10f9289958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.053141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-293d3893-3457-4f83-8b9b-8f10f9289958 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:49.055494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-293d3893-3457-4f83-8b9b-8f10f9289958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.091323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68d5b-4624-40fe-899a-5622a3290715 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.129864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.153706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 989/1975] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:49.153706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0499-9706-4cc2-a99f-d0146ac3cac7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.153706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0499-9706-4cc2-a99f-d0146ac3cac7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.153706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0499-9706-4cc2-a99f-d0146ac3cac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.170962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-affb0499-9706-4cc2-a99f-d0146ac3cac7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:49.172201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-affb0499-9706-4cc2-a99f-d0146ac3cac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.175092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.175828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.176173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.176551 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] PATH_INFO: `/v3/users/157a04ff06de4c80ae1e28d86e5c566c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.177689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=157a04ff06de4c80ae1e28d86e5c566c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.179691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.184280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 990/1976] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:49.184280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.184280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.184280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.224076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:49.225974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.227114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.245333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 991/1977] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:49.247055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.249993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.273419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157a04ff06de4c80ae1e28d86e5c566c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.286853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157a04ff06de4c80ae1e28d86e5c566c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.288301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157a04ff06de4c80ae1e28d86e5c566c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.289055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157a04ff06de4c80ae1e28d86e5c566c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.322198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157a04ff06de4c80ae1e28d86e5c566c'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:49.338410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 987/1978] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:49 2022] DELETE /identity/v3/users/157a04ff06de4c80ae1e28d86e5c566c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:49.339262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.339504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac49966-b061-4245-bd16-32449c01f7f5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.342850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.405823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.406719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.407003 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.407886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.412660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.465925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad2fa-68ba-402d-ae8b-f81b73890f4c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.482639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.483420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.485268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.485639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.486928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:49.487238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.494429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.527350 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 988/1979] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:49.534567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.549766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f94fc-0f6c-41d5-9286-804229851525 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.581722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.583016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.583693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.588114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.589658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.599812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.609276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.613806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.630262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 992/1980] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:49.699003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 989/1981] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:49.709876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.722669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad4d88-c2a6-4a29-9de0-1009ffd58a04 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.739839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.742267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.872698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.890966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696ed3-a8f6-4bc5-9f10-aafe2a9937e1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.898342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.898518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.899251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.899750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.900024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] PATH_INFO: `/v3/users/0d7093dee282477cb203b84d30ac6161` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.901338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.901947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.902356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.903569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.904482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7093dee282477cb203b84d30ac6161)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:49.908137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.908994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:49.938728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.969890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 993/1982] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:49.973864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.976375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.000343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709452d-8d6f-4837-b9a9-05d2a3a1810a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.002214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7093dee282477cb203b84d30ac6161'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.006695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.007514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.007694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.008063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] PATH_INFO: `/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.010655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62b9c21f63f483ca2c94f8bd6241fa0)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.012346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.019669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7093dee282477cb203b84d30ac6161'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.021017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7093dee282477cb203b84d30ac6161'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.022248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7093dee282477cb203b84d30ac6161'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.043483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7093dee282477cb203b84d30ac6161'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.061759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 990/1983] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:49 2022] DELETE /identity/v3/users/0d7093dee282477cb203b84d30ac6161 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:50.063323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.066208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.094650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62b9c21f63f483ca2c94f8bd6241fa0', 'request_id': 'req-d751d877-35fa-4542-9dbd-2214eb404f5c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.104029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62b9c21f63f483ca2c94f8bd6241fa0', 'request_id': 'req-d751d877-35fa-4542-9dbd-2214eb404f5c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.113887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62b9c21f63f483ca2c94f8bd6241fa0', 'request_id': 'req-d751d877-35fa-4542-9dbd-2214eb404f5c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.135361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] The token cache is being invalidate because project f62b9c21f63f483ca2c94f8bd6241fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:50.135716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.136415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d751d877-35fa-4542-9dbd-2214eb404f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.143549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 994/1984] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:49 2022] DELETE /identity/v3/projects/f62b9c21f63f483ca2c94f8bd6241fa0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:50.146970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca77b-0018-4d7c-ac37-4d2fc9ef42c8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.146970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca77b-0018-4d7c-ac37-4d2fc9ef42c8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.146970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ca77b-0018-4d7c-ac37-4d2fc9ef42c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.172176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1a5ca77b-0018-4d7c-ac37-4d2fc9ef42c8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:50.174262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1a5ca77b-0018-4d7c-ac37-4d2fc9ef42c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.178452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fef94-9936-42b8-9fc3-5472f75db29d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.260455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.261414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.261601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 995/1985] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:50.261794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.262057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.263875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.263875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.263875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.274413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.276622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.318069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 991/1986] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:50.323721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.326531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.326661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:50.327801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.337603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 996/1987] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:50.349718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.351285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.367540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645b1d4-808f-4265-b8e8-3c9eda44fc5c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.373279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.373988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.374273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.374953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] PATH_INFO: `/v3/projects/fa4147f85d614ce0a1b497c9d3ba8213` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.376795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4147f85d614ce0a1b497c9d3ba8213)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.379044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.393019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:50.415738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553205-4bce-4a0e-ae5d-e99a550b8caf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.420936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.421944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.422240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.422699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.435240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.437725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.443977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4147f85d614ce0a1b497c9d3ba8213', 'request_id': 'req-52b17efc-d713-4237-bdd0-6ed2604741e9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.447542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:50.453735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4147f85d614ce0a1b497c9d3ba8213', 'request_id': 'req-52b17efc-d713-4237-bdd0-6ed2604741e9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.459885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 992/1988] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:50.459885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.461499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.478217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4147f85d614ce0a1b497c9d3ba8213', 'request_id': 'req-52b17efc-d713-4237-bdd0-6ed2604741e9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.481260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ed55-4e16-46de-aa76-0d371418bb3d service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.498715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] The token cache is being invalidate because project fa4147f85d614ce0a1b497c9d3ba8213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:50.499098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.499885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-52b17efc-d713-4237-bdd0-6ed2604741e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.504849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 997/1989] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:50 2022] DELETE /identity/v3/projects/fa4147f85d614ce0a1b497c9d3ba8213 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:50.506303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.506596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.506880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.555503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:50.557106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.584205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.585598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.585845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.586207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.586774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.589245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.605002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 993/1990] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:50.606035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.608956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.625011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0e33-4716-4ee4-b3f4-a2910b83134e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.636804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.636804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.636804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.636804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] PATH_INFO: `/v3/users/30767f62c9dc4ec399889b12d7f7b07a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.637659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30767f62c9dc4ec399889b12d7f7b07a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.640858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.667087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 998/1991] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:50.668483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.670127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.686103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cc71d-e343-43c0-bc54-d81b473a0faf None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.693026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:50.693473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.693746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.694110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] PATH_INFO: `/v3/projects/bea64efa6d654a5aafddb84078f2867c/users/610bbf50192d4a1bb90cda49a9f2b84f/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.735427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea64efa6d654a5aafddb84078f2867c, user_id=610bbf50192d4a1bb90cda49a9f2b84f, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.744171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.756421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30767f62c9dc4ec399889b12d7f7b07a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.769581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30767f62c9dc4ec399889b12d7f7b07a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.772734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30767f62c9dc4ec399889b12d7f7b07a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.772734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30767f62c9dc4ec399889b12d7f7b07a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.787433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 999/1992] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:50 2022] PUT /identity/v3/projects/bea64efa6d654a5aafddb84078f2867c/users/610bbf50192d4a1bb90cda49a9f2b84f/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:50.789982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:50.792294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.832955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ab432acb-5eb1-4f1c-9b18-e05b8789e2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30767f62c9dc4ec399889b12d7f7b07a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:50.851249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 994/1993] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:50 2022] DELETE /identity/v3/users/30767f62c9dc4ec399889b12d7f7b07a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:50.856306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:50.856615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:50.859081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:50.889654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76551ea9-d5ec-4ffe-a351-bf47e9bc34a8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:50.895001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] MFA Rules not processed for user `610bbf50192d4a1bb90cda49a9f2b84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:50.896533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:50.995596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:51.021958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.022504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.022784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.023331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.024061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:51.025510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.029569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.040455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 995/1994] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:51.041741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.043142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.043721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:51.059080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1000/1995] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:51.065008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.072394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf5bd-f07f-4539-b47f-4c84c763062b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.076675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27f1b5-a338-4ca4-b67e-2f309c85693f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.082193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.082733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.083084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.083397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.083740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.084013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.084170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.084715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.085963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.086829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.087154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.090208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.133102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1001/1996] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:51 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:51.135045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.197742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 996/1997] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:51 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:44:51.197742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.199436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.303725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4eeff-4510-4777-91f0-d6a8d1ba1afb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.339785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59546-a440-4e4d-9930-9d2dfecae6da admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.355528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.356557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.357185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.357972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] PATH_INFO: `/v3/projects/e34ce53e054c46b082ff2670c2343833` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.362536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e34ce53e054c46b082ff2670c2343833)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.369542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.418017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.419731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.420233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.420540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.422226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.426907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.482869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1002/1998] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:51 2022] POST /identity/v3/users => generated 299 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:51.486993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.505746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ff3df-52c5-4e07-8e82-cb6adcf6562b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.514516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e34ce53e054c46b082ff2670c2343833', 'request_id': 'req-1c59e388-e556-4c2b-9105-7a018c62d2a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.536200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e34ce53e054c46b082ff2670c2343833', 'request_id': 'req-1c59e388-e556-4c2b-9105-7a018c62d2a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.549454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e34ce53e054c46b082ff2670c2343833', 'request_id': 'req-1c59e388-e556-4c2b-9105-7a018c62d2a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.567545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] The token cache is being invalidate because project e34ce53e054c46b082ff2670c2343833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:51.567853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.568664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.570321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 997/1999] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:51 2022] DELETE /identity/v3/projects/e34ce53e054c46b082ff2670c2343833 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:51.571117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.572493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.589818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.590865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.591379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.591829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.593140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.595997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.635096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1003/2000] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:51 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:51.636441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.638517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.647767 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:51.649250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:51.655638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eafff-ed85-4789-b9db-f94831957304 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.663536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.664471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.664936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.665360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.666550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.669920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.670383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59e388-e556-4c2b-9105-7a018c62d2a8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.680392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.681403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.681789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.682177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] PATH_INFO: `/v3/projects/8581c9cc2cf54908ab421bbf49c186d8` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.683724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8581c9cc2cf54908ab421bbf49c186d8)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.685751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.693063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1004/2001] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:51.694557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.697145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.721243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcbd95-516f-4fd3-adc4-6b0bbe8c8e8d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.730228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.731267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.731741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.732391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] PATH_INFO: `/v3/users/ba5600d2e26e4def904930219f7da36e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.734966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5600d2e26e4def904930219f7da36e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.738607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.749407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8581c9cc2cf54908ab421bbf49c186d8', 'request_id': 'req-5dc5904b-ba64-4363-b80f-b36231f6c4e0'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.761954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8581c9cc2cf54908ab421bbf49c186d8', 'request_id': 'req-5dc5904b-ba64-4363-b80f-b36231f6c4e0'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.775004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8581c9cc2cf54908ab421bbf49c186d8', 'request_id': 'req-5dc5904b-ba64-4363-b80f-b36231f6c4e0'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.793657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] The token cache is being invalidate because project 8581c9cc2cf54908ab421bbf49c186d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:51.794245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.795338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.797678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 998/2002] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:51 2022] DELETE /identity/v3/projects/8581c9cc2cf54908ab421bbf49c186d8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:51.799568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.801579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.813909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5600d2e26e4def904930219f7da36e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.815975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5600d2e26e4def904930219f7da36e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.827123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5600d2e26e4def904930219f7da36e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.844812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5600d2e26e4def904930219f7da36e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.855434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5600d2e26e4def904930219f7da36e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:51.865093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1005/2003] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:51 2022] DELETE /identity/v3/users/ba5600d2e26e4def904930219f7da36e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:51.865970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:51.867353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:51.893910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5904b-ba64-4363-b80f-b36231f6c4e0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.959481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119df773-edfd-4060-8862-a622ec9fbf5c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:51.965871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.966619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.966825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.967050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.967911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.969908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.976688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:51.977642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:51.978185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:51.978704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:51.979972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:51.982082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43f98f-d041-4ca0-be8a-45a301f333ed admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:51.995676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 999/2004] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:51.998875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1006/2005] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:52.000624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.003860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.012347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.012677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.013035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.028939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cec81-dad7-4ef9-af53-cec0484b24a4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.035471 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.037304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.037304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.037304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.037801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.039180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.045026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.049783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.058423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1007/2006] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:52.062482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.068225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1000/2007] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.069227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.081594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ce23f-1b4c-4763-98d8-183282fe8b03 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.087266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.088199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.088564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.088929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] PATH_INFO: `/v3/projects/85a5e1a327bd4ecc8e19dc44df688a86/users/95a2e78a2dca49d4b85e23c70e64cff4/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.094035 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1d62-864c-4b0d-8ed3-fda3f3a0d6b0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.101150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.101911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.102190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.102463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] PATH_INFO: `/v3/projects/539965d9b4e04ef8a33ff24c85d7e289/users/3ef98aabc0eb43ba8f83e1fcff418d08/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.106521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:52.113862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a5e1a327bd4ecc8e19dc44df688a86, user_id=95a2e78a2dca49d4b85e23c70e64cff4, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.117607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eafb25-287b-4064-af7e-033a550e99f0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.123323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539965d9b4e04ef8a33ff24c85d7e289, user_id=3ef98aabc0eb43ba8f83e1fcff418d08, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.126901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259ead-f438-4ce5-93e7-d333f41dd467 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.136182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1001/2008] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:52 2022] PUT /identity/v3/projects/85a5e1a327bd4ecc8e19dc44df688a86/users/95a2e78a2dca49d4b85e23c70e64cff4/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:52.138074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a521-f665-4734-8920-58da99a92d32 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.138422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a521-f665-4734-8920-58da99a92d32 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.138776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a521-f665-4734-8920-58da99a92d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.151060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1008/2009] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:52 2022] PUT /identity/v3/projects/539965d9b4e04ef8a33ff24c85d7e289/users/3ef98aabc0eb43ba8f83e1fcff418d08/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:52.152382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.152668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.155587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.165325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0691a521-f665-4734-8920-58da99a92d32 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.166638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0691a521-f665-4734-8920-58da99a92d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.196707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] MFA Rules not processed for user `95a2e78a2dca49d4b85e23c70e64cff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.198177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.215913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:52.278201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1002/2010] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.279938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.281335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.281912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.318054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] MFA Rules not processed for user `3ef98aabc0eb43ba8f83e1fcff418d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.319648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.338629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1009/2011] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.339560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.346276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.365022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e40ff7-5a85-4950-bc5c-74f31ad2bb34 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.370376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.371891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.372419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.373104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] PATH_INFO: `/v3/projects/6443bdd9f5d540429cb2d649952456c4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.374494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6443bdd9f5d540429cb2d649952456c4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.376445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.438045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6443bdd9f5d540429cb2d649952456c4', 'request_id': 'req-ff87d7be-1af6-4383-b40e-14a4101b0922'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:52.442231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1003/2012] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.443534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.449284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6443bdd9f5d540429cb2d649952456c4', 'request_id': 'req-ff87d7be-1af6-4383-b40e-14a4101b0922'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:52.458834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9fe8f-0e46-4a25-aaee-fa157b5c5b1a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.461879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6443bdd9f5d540429cb2d649952456c4', 'request_id': 'req-ff87d7be-1af6-4383-b40e-14a4101b0922'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:52.499132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] The token cache is being invalidate because project 6443bdd9f5d540429cb2d649952456c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:52.499417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:52.500088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:52.503206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1010/2013] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:52 2022] DELETE /identity/v3/projects/6443bdd9f5d540429cb2d649952456c4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:52.503206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.504275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.555854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.556901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.558067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.558067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.558792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:52.559102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.560907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.582964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1004/2014] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:52.584259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.586495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.603580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd42929-4916-4417-9827-ab8bff92141e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.627393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.628152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.628506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.628836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.629623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.632022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22b1cb-c84d-4263-a13d-62da2b782ba0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.641278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87d7be-1af6-4383-b40e-14a4101b0922 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.649883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.650527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.650862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.651140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.651787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.653818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.659613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:52.699587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1005/2015] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/projects => generated 401 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:52.699587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.699587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.699587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.724476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1011/2016] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:52.726844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.730336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.749915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.752195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.774434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:52.828121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4337961-ec2f-4fdb-b7d9-788fc0a6fdd9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.834620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.835293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.835583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.835840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.836545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.839103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.847609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1006/2017] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.847609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.868024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1a598-5b20-47ad-afec-02cb54ff8e81 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:52.874178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:52.874811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.875090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.875362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.876360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:52.880580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771364f3-7161-4e6e-9d11-36d476ec9a8b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:52.882798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1012/2018] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:52.883854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.932890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1007/2019] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/users => generated 307 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:52.932890 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.933393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.933684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.955268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.957180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.987229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da941b49-83bc-446c-aeae-61b33894b680 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.013380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.013380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.013380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.013380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.013737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.014573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.053497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1013/2020] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:53.055731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.077643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ff75-fca4-4c4c-9369-7075fdb3cad0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.088462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.090463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.091248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.092030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.093638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.098037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.126195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1008/2021] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:53.128007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.160314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1014/2022] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:53.161519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1d5e5-a665-493a-86b4-e822f696e142 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.163483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.174405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.174761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.175042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.175318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.175984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.177814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.187076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7050ef-9ebd-45d7-a23e-4de571e5c3e6 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.190540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1009/2023] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.191514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.197031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.198143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.198666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.199178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.200662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.202565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac79aa6-6a3f-4bd9-bc7d-c62769a0c842 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.205074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.209559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.210168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.210447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.210721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.211373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:53.211685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.213363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.220737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1015/2024] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.222419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.232112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1010/2025] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:53.232112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.236980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf765018-82cf-455b-8d0e-5f04fb69f455 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.241996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.242617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.242895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.243320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.243970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.244416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d7-1ca4-418a-98ca-6f75c893758a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.245880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.250262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.251233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.251694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.252240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] PATH_INFO: `/v3/projects/e06523c5ce2e4568aea6e403e6516081/users/65222f20e22a437d81563a717f358da5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.258108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1016/2026] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.259248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.273293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca0cc4-028c-49de-88ff-127360e729b7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.275041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06523c5ce2e4568aea6e403e6516081, user_id=65222f20e22a437d81563a717f358da5, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.278016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.279980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.280660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.281814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.282354 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] PATH_INFO: `/v3/projects/9687eba6286040b09651e53191b051ea/users/c1f26429f88b450985dfab475cef265e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.298093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1011/2027] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:53 2022] PUT /identity/v3/projects/e06523c5ce2e4568aea6e403e6516081/users/65222f20e22a437d81563a717f358da5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:53.299153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.303669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9687eba6286040b09651e53191b051ea, user_id=c1f26429f88b450985dfab475cef265e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.306618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.325482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1017/2028] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:53 2022] PUT /identity/v3/projects/9687eba6286040b09651e53191b051ea/users/c1f26429f88b450985dfab475cef265e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:53.326268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.351367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.377663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.390987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c24003-06b9-4d1f-b31e-a7e42a01490f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.415714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003966-f64f-467f-a7be-7790e2c2562f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.424187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.425288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.425375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.425655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.430222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.430222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.441291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1018/2029] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.442527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.459901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21339c90-398d-44db-8071-d31152fe3d0c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.476834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.476834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.476834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.476834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.480360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.480627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.481304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.481954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.482234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.482507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.484850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.487404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.518990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1019/2030] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.518990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.549592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433b542-4d93-4391-abe4-915309aed85a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.566651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1012/2031] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:53.574697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.575367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.576371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.579454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.580375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.580501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.585982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.613162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1020/2032] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:53.614237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.643083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a1be-df34-4289-834a-33a71199ca6a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.681666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c386a7-bb83-4f7d-ae00-8151cbe1f3fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.688967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.689774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.690131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.690493 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] PATH_INFO: `/v3/projects/01b05ed6b9234d15811075d54d40980c/users/19886d5c79f846bfb091145983edaf91/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.709472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b05ed6b9234d15811075d54d40980c, user_id=19886d5c79f846bfb091145983edaf91, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.712976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.738255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1013/2033] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:53 2022] PUT /identity/v3/projects/01b05ed6b9234d15811075d54d40980c/users/19886d5c79f846bfb091145983edaf91/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:53.741426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.742196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.742534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.742883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] PATH_INFO: `/v3/projects/e06523c5ce2e4568aea6e403e6516081/users/65222f20e22a437d81563a717f358da5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.744166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.745217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06523c5ce2e4568aea6e403e6516081, user_id=65222f20e22a437d81563a717f358da5, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.750708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.768881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1021/2034] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:53 2022] PUT /identity/v3/projects/e06523c5ce2e4568aea6e403e6516081/users/65222f20e22a437d81563a717f358da5/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:53.770953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:53.845808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.867024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a2429-6064-42bc-bd83-158138544447 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.870454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89002f-1d17-4065-846d-d6a04c94b016 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.874492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.875536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.876008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.876120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.876468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.877166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.877993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.878367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.878715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] PATH_INFO: `/v3/projects/9687eba6286040b09651e53191b051ea/users/c1f26429f88b450985dfab475cef265e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.879130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987ef7-921f-4a1f-b911-bb8e21862ed3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.880873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9687eba6286040b09651e53191b051ea, user_id=c1f26429f88b450985dfab475cef265e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.883641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94990396-274f-4165-897b-7d2e19f9eb08 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.898085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1022/2035] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:53 2022] PUT /identity/v3/projects/9687eba6286040b09651e53191b051ea/users/c1f26429f88b450985dfab475cef265e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:53.899514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.899812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.900111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.909739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1014/2036] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:53.911774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaadfa-ed89-406d-bbb8-395f7c8804ed None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.912372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaadfa-ed89-406d-bbb8-395f7c8804ed None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.912833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaadfa-ed89-406d-bbb8-395f7c8804ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.942530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] MFA Rules not processed for user `19886d5c79f846bfb091145983edaf91`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:53.944592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:53.948799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2cbaadfa-ed89-406d-bbb8-395f7c8804ed None None] MFA Rules not processed for user `65222f20e22a437d81563a717f358da5`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:53.948799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2cbaadfa-ed89-406d-bbb8-395f7c8804ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:53.979575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:54.037463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1015/2037] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:54.039457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.039806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.040363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.058133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1023/2038] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:54.059336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.083544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] MFA Rules not processed for user `c1f26429f88b450985dfab475cef265e`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:54.085207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.150875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5381def-5fa0-4b06-af37-708eb679e6d3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.156389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.157054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.157328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.157744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.158627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.160275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.175654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1024/2039] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:54.176803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.178396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.194168 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1016/2040] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:54.195220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.196819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.255335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b64fd-effc-409a-bc6c-4d09a8f6dde8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.259764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.260649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.261544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.261856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.267251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:54.274777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.277136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.282336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cb8b0-f769-4821-92ee-f101d75e1df1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.290013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.290761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.294759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.294883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1025/2041] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:54.294974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.295062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.306544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1734a-21c6-48b9-9875-488d8f5263d4 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.313570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.314673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.314962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.315515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.316223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.317982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.324944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.327358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.339881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1026/2042] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:54.341342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1017/2043] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:54.341776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.355296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ee76-b5ec-4feb-999c-8e8e75558c14 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.357502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.365860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.366750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.367128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.367669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] PATH_INFO: `/v3/projects/d6d5643399d84cb798b8e442192700e4/users/dce8c9e129cd4c7bba1580b5d6fd6d8a/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.382569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08138a-b084-450b-9afb-f7044f962f03 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.390747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.392559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.392956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.393451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.397644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.413274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d5643399d84cb798b8e442192700e4, user_id=dce8c9e129cd4c7bba1580b5d6fd6d8a, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.417491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.436169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1027/2044] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:54 2022] PUT /identity/v3/projects/d6d5643399d84cb798b8e442192700e4/users/dce8c9e129cd4c7bba1580b5d6fd6d8a/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:54.437244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.488951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:54.506926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.508354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.519949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1018/2045] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:54.521185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.530106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64de7b-cca4-4a06-9ca3-1d97ddbd5db9 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.545370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61ae33-26c6-45d9-aca4-9d3e793ad5cb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:54.555061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.555750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.556032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.556303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] PATH_INFO: `/v3/users/19886d5c79f846bfb091145983edaf91` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.558128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19886d5c79f846bfb091145983edaf91)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.561898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.612101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:54.613062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.613362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.613625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.617152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.634833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19886d5c79f846bfb091145983edaf91'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:54.635602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19886d5c79f846bfb091145983edaf91'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:54.651937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19886d5c79f846bfb091145983edaf91'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:54.670951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19886d5c79f846bfb091145983edaf91'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:54.683091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6905cf1f-289d-472d-a022-78fe9c5a7ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19886d5c79f846bfb091145983edaf91'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:54.695846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1028/2046] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:54 2022] DELETE /identity/v3/users/19886d5c79f846bfb091145983edaf91 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:54.695846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.696160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.696264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.729645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:54.731742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4cf27-5bbd-4da4-8611-5b664b58ae2f service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:54.740365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] MFA Rules not processed for user `dce8c9e129cd4c7bba1580b5d6fd6d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:54.742688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.744674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1019/2047] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:54.746296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:54.746580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:54.746854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:54.772682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:54.774582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:54.823031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1029/2048] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:54.864798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:54.988335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:54.990529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.014796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1020/2049] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:55.037748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:55.040128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.108784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:55.155425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1adef9-9a21-4519-8aa2-ec0b94230d25 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:55.163976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:55.164977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.165355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.165727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.190433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:55.192274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:55.205688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1030/2050] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:55.248727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6219b-9315-4c1c-bdb3-5aed4ef84254 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:55.253937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:55.254573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.254908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.256729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.274175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:55.276051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.284127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:55.285992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f417eb8-c7fd-4303-a82e-3ab00c1b8f4a service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:55.312051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1021/2051] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:55.323899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4fc8d-730f-4372-9e0c-2655d09a99bc service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:55.332572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:55.333439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.333720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.333989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] PATH_INFO: `/v3/users/dce8c9e129cd4c7bba1580b5d6fd6d8a` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.335273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce8c9e129cd4c7bba1580b5d6fd6d8a)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:55.337260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:55.440045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce8c9e129cd4c7bba1580b5d6fd6d8a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.444147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce8c9e129cd4c7bba1580b5d6fd6d8a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.458981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce8c9e129cd4c7bba1580b5d6fd6d8a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.486419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce8c9e129cd4c7bba1580b5d6fd6d8a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.495893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce8c9e129cd4c7bba1580b5d6fd6d8a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.504307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1031/2052] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:44:55 2022] DELETE /identity/v3/users/dce8c9e129cd4c7bba1580b5d6fd6d8a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:55.510214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.511710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.512398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.540340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:55.541637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.639180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1022/2053] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:55.653858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:55.655510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.756494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699e07-1981-4838-98ec-fbbaf44e3c74 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:55.762094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:55.762996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.763275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.764114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.778553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:55.780261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae16a4-ad8d-433e-a9f0-5fb23448bd68 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:55.793190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1032/2054] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:55.814096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:55.815486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.830766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3132b48-61ba-414b-8c24-123578fb81bc None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:55.835938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:55.836181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.836435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.836713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] PATH_INFO: `/v3/projects/01b05ed6b9234d15811075d54d40980c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.838024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b05ed6b9234d15811075d54d40980c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:55.839992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:55.923891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b05ed6b9234d15811075d54d40980c', 'request_id': 'req-6eeffd88-ba12-4214-b20d-e45c7b0448b5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.934868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b05ed6b9234d15811075d54d40980c', 'request_id': 'req-6eeffd88-ba12-4214-b20d-e45c7b0448b5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.945989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b05ed6b9234d15811075d54d40980c', 'request_id': 'req-6eeffd88-ba12-4214-b20d-e45c7b0448b5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.967944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] The token cache is being invalidate because project 01b05ed6b9234d15811075d54d40980c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:55.968290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.969052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6eeffd88-ba12-4214-b20d-e45c7b0448b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:55.971356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1023/2055] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:55 2022] DELETE /identity/v3/projects/01b05ed6b9234d15811075d54d40980c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:55.978061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.978547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.979020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.010548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:56.012479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.081067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.097187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1033/2056] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:56.105300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.105841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.106302 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.127092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.143093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:56.145289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.163679 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1024/2057] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:56.165113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.176953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78737d8-f8a9-4ac2-9709-89ee88d4f5b2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.187840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.188557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.188955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.189288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.190017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:56.190385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.192115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.208809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1034/2058] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:56.212978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.242456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19e361-fc22-4456-8314-f656abc209bd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.257328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.259225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.260464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.261544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.264192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.272653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.323300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1025/2059] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:56 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:56.328008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.346395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbbb39-85e1-47ef-a006-1f1a5a383ada admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.358351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.362037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.495761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e603d-159a-4682-9264-1be17c9e03d1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.506462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.507119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.508334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.509535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] PATH_INFO: `/v3/projects/d6d5643399d84cb798b8e442192700e4` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.511519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d5643399d84cb798b8e442192700e4)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.514575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.526293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.528952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.531232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.531515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.532203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.539776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.593475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1035/2060] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:56 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:56.599013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.632387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f275-616b-4e45-992b-f91364b773b1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.675583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d5643399d84cb798b8e442192700e4', 'request_id': 'req-a6bbd744-29ba-405d-bc22-bff1699fb6d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:56.687728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d5643399d84cb798b8e442192700e4', 'request_id': 'req-a6bbd744-29ba-405d-bc22-bff1699fb6d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:56.702624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d5643399d84cb798b8e442192700e4', 'request_id': 'req-a6bbd744-29ba-405d-bc22-bff1699fb6d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:56.723033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] The token cache is being invalidate because project d6d5643399d84cb798b8e442192700e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:44:56.723387 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:56.724169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-a6bbd744-29ba-405d-bc22-bff1699fb6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:44:56.729019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1026/2061] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:44:56 2022] DELETE /identity/v3/projects/d6d5643399d84cb798b8e442192700e4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:44:56.731327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.731617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.731986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.834467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:56.841869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.850594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.851533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.851823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.853001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.855071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.856915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b7ff9-319d-4aac-bbba-25cbf2932430 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.863842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1027/2062] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:56.864703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.870136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.881936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1036/2063] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:56.883507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.884010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.884304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.928846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:56.930102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.961867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1037/2064] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:56.962580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.967253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:57.005121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf2b62-85ed-4013-a974-a9685a5e36ac None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.013243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.014383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.014941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.015514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.016690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.020516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.034433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d371c5-fe29-499d-88ac-9008dd1080d2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.042218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1038/2065] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:44:57.043779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.046171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.047080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.047871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.049226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.057584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:57.068283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b71ce-584f-4bef-8e45-dbccb3a54647 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.076376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.077480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.078024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.078709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.080912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:44:57.081668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.084841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.120788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1039/2066] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:44:57.120788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.124781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:57.152551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50fea7-e817-4b0d-b4d1-59a6365f822e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.163775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.165123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.165889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.166548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] PATH_INFO: `/v3/projects/4fd4aeb30868416b88c17580321f49dc/users/d0ddc2b236a6442e96682f9945c895ff/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.226523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.226982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.233764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd4aeb30868416b88c17580321f49dc, user_id=d0ddc2b236a6442e96682f9945c895ff, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.246166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1028/2067] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:57.247099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.255550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8634-de71-473f-84cd-22f99498cc88 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.266826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd22ec-e25f-481f-9b80-da2b0f250b06 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.280403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.291359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1040/2068] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:57 2022] PUT /identity/v3/projects/4fd4aeb30868416b88c17580321f49dc/users/d0ddc2b236a6442e96682f9945c895ff/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:57.291581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.291930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.292222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.292956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.294645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.294927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.295206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.297512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.362005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1029/2069] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:44:57 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:57.370919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.391187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:57.407085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] MFA Rules not processed for user `d0ddc2b236a6442e96682f9945c895ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:57.416382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:57.556645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f174c9-af86-436e-b3e4-0b384e20d232 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.574730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.578199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.578753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.579266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.580511 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.589435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.617720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1041/2070] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:57.637890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.640154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:57.672901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1030/2071] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:44:57 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:44:57.674708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.698204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705f9a6-e373-4d2d-b2cb-e67ce21f1d26 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.714847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.715486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.715761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.716057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.717051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.718962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.757185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1031/2072] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:57.758254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.785424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ba5e-be89-43f1-b4d8-4bd0fdff6505 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.832993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.832993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.832993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.832993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.833594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.833594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.839179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1032/2073] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:44:57.851804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:57.874840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198584fa-bb86-407d-b764-7b8e4038dbdc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.876347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd64c-4a9a-451c-8b06-2096ce1fb8e8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:57.887273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.888374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.888936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.889665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.891837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:57.892810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.893199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.893581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] PATH_INFO: `/v3/projects/58ec80a9502847d4a6d896269098a529/users/571ffe0e364e490a8e95accfdfb4f24f/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:57.905813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.907719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858655b0-52c2-43a8-81ac-03f0d34ac345 service glance] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.930540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1042/2074] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:57.941864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ec80a9502847d4a6d896269098a529, user_id=571ffe0e364e490a8e95accfdfb4f24f, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:57.944803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:57.975687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1033/2075] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:44:57 2022] PUT /identity/v3/projects/58ec80a9502847d4a6d896269098a529/users/571ffe0e364e490a8e95accfdfb4f24f/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:44:57.989667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:57.990040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:57.990237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.027007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] MFA Rules not processed for user `571ffe0e364e490a8e95accfdfb4f24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:58.028505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:58.190805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1043/2076] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:58.405414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:58.409119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:58.552607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:58.583371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dd7c8-47f8-449a-b4c3-585d8d86edc7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:58.598242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:58.604031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:58.604603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:58.604791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.651660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:58.654767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:58.673891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1034/2077] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:59.509650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:59.527593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f3677-44f9-42d6-a370-61755ee2f679 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:59.540641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:59.542547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:59.542876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:59.543216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:59.550631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:59.618315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:59.803496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:59.816218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fa6c8-d88d-4406-8db2-0a4a05a61e69 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:59.834785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1044/2078] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:01.371761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:01.378099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:01.561498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb275405-21dd-4541-9eec-3bb383b47452 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:01.583352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:01.586996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:01.587310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:01.587593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] PATH_INFO: `/v3/users/3ef98aabc0eb43ba8f83e1fcff418d08` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:01.597213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef98aabc0eb43ba8f83e1fcff418d08)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:01.606850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:01.614722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe985-2df5-4547-9559-669cb0618889 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:01.615343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe985-2df5-4547-9559-669cb0618889 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:01.615343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe985-2df5-4547-9559-669cb0618889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:01.665444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c1cfe985-2df5-4547-9559-669cb0618889 None None] MFA Rules not processed for user `571ffe0e364e490a8e95accfdfb4f24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:01.667458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c1cfe985-2df5-4547-9559-669cb0618889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:01.701064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1045/2079] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:01.768371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef98aabc0eb43ba8f83e1fcff418d08'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:01.780433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef98aabc0eb43ba8f83e1fcff418d08'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:01.781507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef98aabc0eb43ba8f83e1fcff418d08'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:01.783495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef98aabc0eb43ba8f83e1fcff418d08'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:01.809484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef98aabc0eb43ba8f83e1fcff418d08'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:01.828112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1035/2080] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:01 2022] DELETE /identity/v3/users/3ef98aabc0eb43ba8f83e1fcff418d08 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:01.832990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:01.833467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:01.835086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:01.861836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:01.862687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:01.973007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1046/2081] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:01.982559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:01.984148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:02.101044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47a326-f133-4fd1-a3bb-c4feab3a4c2f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:02.105261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:02.106309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:02.106591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:02.106864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:02.120885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:02.122298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:02.137110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1036/2082] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:02.538638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:02.540481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:02.564180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c589dc-3c4b-4d55-b2a8-57af14a2bd2d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:02.570811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:02.571950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:02.572225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:02.572549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] PATH_INFO: `/v3/projects/539965d9b4e04ef8a33ff24c85d7e289` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:02.573729 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539965d9b4e04ef8a33ff24c85d7e289)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:02.575853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:02.643294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539965d9b4e04ef8a33ff24c85d7e289', 'request_id': 'req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:02.665178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539965d9b4e04ef8a33ff24c85d7e289', 'request_id': 'req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:02.684289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539965d9b4e04ef8a33ff24c85d7e289', 'request_id': 'req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:02.716926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] The token cache is being invalidate because project 539965d9b4e04ef8a33ff24c85d7e289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:02.717278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:02.721668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:02.726575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1047/2083] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:02 2022] DELETE /identity/v3/projects/539965d9b4e04ef8a33ff24c85d7e289 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:02.727503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:02.735492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:02.745353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36412a-bd6c-4180-8318-e14473c3aa05 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:02.903935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:02.905274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:02.905471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:02.905841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] PATH_INFO: `/v3/users/65222f20e22a437d81563a717f358da5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:02.909460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65222f20e22a437d81563a717f358da5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:02.911927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:03.029713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65222f20e22a437d81563a717f358da5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.048501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65222f20e22a437d81563a717f358da5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.050517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65222f20e22a437d81563a717f358da5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.057319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65222f20e22a437d81563a717f358da5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.096614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-04b6c61c-b3ea-43c9-a99b-4d1773ad9e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65222f20e22a437d81563a717f358da5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.116407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1037/2084] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:02 2022] DELETE /identity/v3/users/65222f20e22a437d81563a717f358da5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:03.511050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:03.513935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:03.531210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a6c6b-87e1-4bfc-b525-f8b6bf27d9d8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:03.568932 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:03.617475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:03.618277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:03.618559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:03.618894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] PATH_INFO: `/v3/projects/e06523c5ce2e4568aea6e403e6516081` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:03.620154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06523c5ce2e4568aea6e403e6516081)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:03.622134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:03.680646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06523c5ce2e4568aea6e403e6516081', 'request_id': 'req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.687408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06523c5ce2e4568aea6e403e6516081', 'request_id': 'req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.697669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06523c5ce2e4568aea6e403e6516081', 'request_id': 'req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.711272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] The token cache is being invalidate because project e06523c5ce2e4568aea6e403e6516081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:03.711553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.712268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-32653eb1-bc9c-4c1a-8ab7-7b44929670c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:03.713867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1048/2085] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:03 2022] DELETE /identity/v3/projects/e06523c5ce2e4568aea6e403e6516081 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:03.721889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:03.722172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:03.722446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:03.743287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:03.744491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:03.832986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1038/2086] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:03.838231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:03.838857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:03.839144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:03.878657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:03.881244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:03.894910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1049/2087] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:03.899392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:03.912612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936f827-1d3b-4ef3-bedf-97e9a300b4b2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:03.920056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:03.920665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:03.920977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:03.921253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:03.921917 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:03.922221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:03.927094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:03.941872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1039/2088] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:03.946485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:03.961124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ca3fc-e336-4141-af24-8674f644f643 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:03.966567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:03.967551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:03.967878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:03.968150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:03.969268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:03.973803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.012219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1050/2089] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:03 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:04.017282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.028425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec6bf-6333-4ca5-8b73-a76581603a18 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.044901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:04.124354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.125184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.125562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.126711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.127537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.129765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.160694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1040/2090] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:04 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:04.162543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.187160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b727f5-cd2c-4f2d-988f-f4d6987d998a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.194065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.195310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.196204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.196204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.196839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.199006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.217321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1051/2091] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:04.222787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.245854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738b62-08bb-4bab-a61f-987d74d68710 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.256507 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.263034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.263034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.263034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.265839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.268368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.285950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1041/2092] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:04.290022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.301372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b8854-88c4-40d2-9c07-0dcb7f1d1c5a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.319357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.320277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.320663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.321139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] PATH_INFO: `/v3/projects/7b9dc98233aa4826a5f0a61cad4bedda/users/be3dd573d155446ca2c4dd0324873ced/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.339416 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9dc98233aa4826a5f0a61cad4bedda, user_id=be3dd573d155446ca2c4dd0324873ced, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.342113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.343522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f368d-60b9-475a-a98b-00bd7b82552a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.343965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.360659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6026aa0-0f70-4730-83b9-c6a85106703b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.364373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1052/2093] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:04 2022] PUT /identity/v3/projects/7b9dc98233aa4826a5f0a61cad4bedda/users/be3dd573d155446ca2c4dd0324873ced/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:04.375801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.377339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.377339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.413078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] MFA Rules not processed for user `be3dd573d155446ca2c4dd0324873ced`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:04.415069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.451809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.452900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.453280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.453639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] PATH_INFO: `/v3/users/610bbf50192d4a1bb90cda49a9f2b84f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.456828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=610bbf50192d4a1bb90cda49a9f2b84f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.458669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.471879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:04.511117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1053/2094] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:04.524883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.527227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.552458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610bbf50192d4a1bb90cda49a9f2b84f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.563120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610bbf50192d4a1bb90cda49a9f2b84f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.564721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610bbf50192d4a1bb90cda49a9f2b84f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.565489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610bbf50192d4a1bb90cda49a9f2b84f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.586145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d327dd67-91b5-4e3b-9c5b-6ec93b45a00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610bbf50192d4a1bb90cda49a9f2b84f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.604111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1042/2095] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:04 2022] DELETE /identity/v3/users/610bbf50192d4a1bb90cda49a9f2b84f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:04.615732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.616174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.616563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.631246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f88a92-b08c-44f9-92e2-435eec8a1827 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.635436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:04.643934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:04.658826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.697705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.698328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.698605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.699020 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.701029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.821232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1043/2096] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:04.823822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.829235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.830789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.832618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.864196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1054/2097] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:04.876716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.878235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.893140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0f3c-a51c-4c12-9246-264e155d2b80 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.898237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622046-93be-4488-a354-89d260754642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.898967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622046-93be-4488-a354-89d260754642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.899308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622046-93be-4488-a354-89d260754642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.899641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622046-93be-4488-a354-89d260754642 admin admin] PATH_INFO: `/v3/users/be3dd573d155446ca2c4dd0324873ced` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.900777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622046-93be-4488-a354-89d260754642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3dd573d155446ca2c4dd0324873ced)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.902987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4622046-93be-4488-a354-89d260754642 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.935749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d748fc-8a72-4415-bb2f-536ad84e1571 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:04.941514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:04.942421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.942747 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.943020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.963844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:04.971487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f41249-e042-4827-87ee-d240f0b460b4 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:04.988075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3dd573d155446ca2c4dd0324873ced'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.988341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1044/2098] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:04.988965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3dd573d155446ca2c4dd0324873ced'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:04.991047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:05.013970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3dd573d155446ca2c4dd0324873ced'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.030541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3dd573d155446ca2c4dd0324873ced'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.042037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3dd573d155446ca2c4dd0324873ced'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.050386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1055/2099] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:04 2022] DELETE /identity/v3/users/be3dd573d155446ca2c4dd0324873ced => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:05.055450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.055811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.056154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:05.081449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:05.082770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.153257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1045/2100] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:05.163076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:05.165508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.249188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4622046-93be-4488-a354-89d260754642 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:05.254233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:05.254771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.255136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.255266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:05.271337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:05.272907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:05.283310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1056/2101] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:05.602127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:05.606469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.659468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f4260-d542-44aa-8e63-2f44bee46706 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:05.667393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:05.668064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.668368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.668652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] PATH_INFO: `/v3/projects/bea64efa6d654a5aafddb84078f2867c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:05.670896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea64efa6d654a5aafddb84078f2867c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:05.672300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:05.759162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:05.762088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea64efa6d654a5aafddb84078f2867c', 'request_id': 'req-b08bf07b-f392-4c60-b30c-3777856d3024'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.769368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea64efa6d654a5aafddb84078f2867c', 'request_id': 'req-b08bf07b-f392-4c60-b30c-3777856d3024'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.783641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea64efa6d654a5aafddb84078f2867c', 'request_id': 'req-b08bf07b-f392-4c60-b30c-3777856d3024'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.800748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] The token cache is being invalidate because project bea64efa6d654a5aafddb84078f2867c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:05.801169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.801970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:05.808048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1046/2102] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:05 2022] DELETE /identity/v3/projects/bea64efa6d654a5aafddb84078f2867c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:05.810384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:05.830796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ffa61-db43-436d-aadd-558ad7435138 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:05.946547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:05.947665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.948148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.948532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] PATH_INFO: `/v3/users/95a2e78a2dca49d4b85e23c70e64cff4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:05.949913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a2e78a2dca49d4b85e23c70e64cff4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:05.951844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:05.966601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:05.968187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.989128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bf07b-f392-4c60-b30c-3777856d3024 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:05.995165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:05.995941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.996455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.997065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] PATH_INFO: `/v3/projects/7b9dc98233aa4826a5f0a61cad4bedda` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.000114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9dc98233aa4826a5f0a61cad4bedda)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.002129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.053325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a2e78a2dca49d4b85e23c70e64cff4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.054106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a2e78a2dca49d4b85e23c70e64cff4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.066023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a2e78a2dca49d4b85e23c70e64cff4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.088853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:06.092538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a2e78a2dca49d4b85e23c70e64cff4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.093877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9dc98233aa4826a5f0a61cad4bedda', 'request_id': 'req-24a27f6b-9548-4153-bd15-c38613f83455'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.102000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9dc98233aa4826a5f0a61cad4bedda', 'request_id': 'req-24a27f6b-9548-4153-bd15-c38613f83455'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.116749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9dc98233aa4826a5f0a61cad4bedda', 'request_id': 'req-24a27f6b-9548-4153-bd15-c38613f83455'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.120235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-dfb8c808-8bd9-4e73-8ab7-13e2ecbc7ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a2e78a2dca49d4b85e23c70e64cff4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.130307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1057/2103] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:05 2022] DELETE /identity/v3/users/95a2e78a2dca49d4b85e23c70e64cff4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:06.134095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] The token cache is being invalidate because project 7b9dc98233aa4826a5f0a61cad4bedda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:06.134395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.135103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-24a27f6b-9548-4153-bd15-c38613f83455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:06.141384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1047/2104] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:05 2022] DELETE /identity/v3/projects/7b9dc98233aa4826a5f0a61cad4bedda => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:06.143402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.143724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.143963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.170011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:06.171242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:06.264372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1058/2105] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:06.279370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.279370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.279370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.305979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:06.307840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:06.330083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.338746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1048/2106] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:06.349945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d78135-5ff7-40a8-876f-5df619f38f20 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.356566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.357428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.358076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.358452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.359409 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:06.359777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.361734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.381837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.388018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1059/2107] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:45:06.392558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def20f-3a91-4a60-a345-c79c8f26357a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.400377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.401107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.402021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.402021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.402503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.405237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.456548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1049/2108] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:06 2022] POST /identity/v3/projects => generated 359 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:06.460700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.493121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575db1-caeb-4452-a287-49bcb9c83bf0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.603983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.604974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.605516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.605943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.606941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.611162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.639338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1060/2109] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:06 2022] POST /identity/v3/users => generated 280 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:06.642591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.661402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a58e4a-fb3e-4418-8088-041671d3dcb1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.666608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.667255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.667554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.667822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.668465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.670135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.683595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1050/2110] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:06.687955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.698636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87cdfa-9080-4218-a90e-7f87da83b1fd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.703851 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.704590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.704945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.705316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.708390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.710074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.725251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1061/2111] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:06.738752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.752386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5478-f10f-429d-837a-2a902fa1765a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.769720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:06.772067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.772560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.773096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] PATH_INFO: `/v3/projects/0d5c2910b39741a9b70b05024db8c6cf/users/4a6ae9d587154f1f9351e942c12bbd1c/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.834016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5c2910b39741a9b70b05024db8c6cf, user_id=4a6ae9d587154f1f9351e942c12bbd1c, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:06.841711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d9712-cfcc-4728-84c4-6c12cac6b2a0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:06.843319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:06.846579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:06.888891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af397b3-106b-4e5d-ba3f-41af0731354c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:06.913496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1051/2112] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:06 2022] PUT /identity/v3/projects/0d5c2910b39741a9b70b05024db8c6cf/users/4a6ae9d587154f1f9351e942c12bbd1c/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:06.915981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:06.916476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:06.921195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:06.981417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:07.007726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:07.009279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.009540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.009802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] PATH_INFO: `/v3/projects/85a5e1a327bd4ecc8e19dc44df688a86` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.014854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] MFA Rules not processed for user `4a6ae9d587154f1f9351e942c12bbd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:07.014854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.016057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a5e1a327bd4ecc8e19dc44df688a86)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:07.021365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:07.136380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a5e1a327bd4ecc8e19dc44df688a86', 'request_id': 'req-044cc5e0-d9db-4597-8a62-2a30921d251d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.148816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a5e1a327bd4ecc8e19dc44df688a86', 'request_id': 'req-044cc5e0-d9db-4597-8a62-2a30921d251d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.149548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:07.165608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a5e1a327bd4ecc8e19dc44df688a86', 'request_id': 'req-044cc5e0-d9db-4597-8a62-2a30921d251d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.202652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] The token cache is being invalidate because project 85a5e1a327bd4ecc8e19dc44df688a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:07.203101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.209477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.213358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1062/2113] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:06 2022] DELETE /identity/v3/projects/85a5e1a327bd4ecc8e19dc44df688a86 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:07.217325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:07.221502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.233685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1052/2114] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:07.276852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:07.278430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.343201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cc5e0-d9db-4597-8a62-2a30921d251d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:07.358956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:07.359611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.360027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.360274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] PATH_INFO: `/v3/users/c1f26429f88b450985dfab475cef265e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.363021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f26429f88b450985dfab475cef265e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:07.365544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:07.400383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3702-808a-4b83-9d72-1a3777ebd47d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:07.484355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f26429f88b450985dfab475cef265e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.485504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f26429f88b450985dfab475cef265e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.508847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:07.509564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.509779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.510048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.513698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f26429f88b450985dfab475cef265e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.517875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.548690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f26429f88b450985dfab475cef265e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.567627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f26429f88b450985dfab475cef265e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.575155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1063/2115] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:07 2022] DELETE /identity/v3/users/c1f26429f88b450985dfab475cef265e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:07.651704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:07.654964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459baf86-ca55-42c7-a6e1-aa2d9c8ff2e5 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:07.677688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1053/2116] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:07.702018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:07.704615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.715889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:07.845796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f425e08-7246-4202-978e-856a99aa8096 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:07.848969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:07.849510 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.849955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.850318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] PATH_INFO: `/v3/users/4a6ae9d587154f1f9351e942c12bbd1c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.851710 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6ae9d587154f1f9351e942c12bbd1c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:07.854125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:07.922210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6ae9d587154f1f9351e942c12bbd1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.930911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6ae9d587154f1f9351e942c12bbd1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.945955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6ae9d587154f1f9351e942c12bbd1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.970337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6ae9d587154f1f9351e942c12bbd1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.985512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6ae9d587154f1f9351e942c12bbd1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:07.995802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1064/2117] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:07 2022] DELETE /identity/v3/users/4a6ae9d587154f1f9351e942c12bbd1c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:08.000555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.001595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.002472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.013659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.015717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.028499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:08.030649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.103826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:08.105099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec8c50-4c54-4148-8653-73c51fbfb332 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.110082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.111106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.111385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.111657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] PATH_INFO: `/v3/projects/9687eba6286040b09651e53191b051ea` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.112989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9687eba6286040b09651e53191b051ea)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.114902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.117892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1054/2118] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:08.130987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.132860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.153897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:08.185433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9687eba6286040b09651e53191b051ea', 'request_id': 'req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:08.195712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9687eba6286040b09651e53191b051ea', 'request_id': 'req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:08.210153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5941e5-279b-4bc1-9188-970f8f17c60a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.214291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9687eba6286040b09651e53191b051ea', 'request_id': 'req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:08.232856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] The token cache is being invalidate because project 9687eba6286040b09651e53191b051ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:08.233177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:08.233901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2eae7200-e7ae-4461-ada1-a3271d9f9cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:08.236920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1065/2119] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:08 2022] DELETE /identity/v3/projects/9687eba6286040b09651e53191b051ea => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:08.243924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4bfd6-b538-4550-a045-d1a1eaf0c27f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.246005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4bfd6-b538-4550-a045-d1a1eaf0c27f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.246418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4bfd6-b538-4550-a045-d1a1eaf0c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.281721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-51a4bfd6-b538-4550-a045-d1a1eaf0c27f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:08.284175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-51a4bfd6-b538-4550-a045-d1a1eaf0c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.289552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.290181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.290465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.290739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.292561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.384275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1066/2120] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:08.387602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.389698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.393530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.393821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.394102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.408476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1055/2121] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:08.419781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:08.423389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.436732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1067/2122] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:08.437777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.449367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7256a2-0a1c-49a8-84e4-0c70884d84c8 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.455455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.456084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.456363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.456635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.457419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:08.457727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.459370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.478711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1056/2123] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:08.482804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.498419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95ca3e-5ac5-4549-a60e-d9bd442478aa None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.505216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.506381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.506982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.507263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.509642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.513435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.553040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1068/2124] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:08 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:08.557269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.573121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818d5bb-ca6e-4fbf-b9e3-ba78df50bfe4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.695802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:08.725064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.725886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.726272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.726706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.727618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.731133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.778001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1057/2125] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:08 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:08.782898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.809903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea17d3d-0579-4e02-9774-1b2e30852f57 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.820152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.821378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.821864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.823506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.831695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.835052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.848790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1069/2126] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:08.863425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.881897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f734c1d-e01f-481a-b22f-a0b50f5635ce admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.895379 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.896459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.896884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.897245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.898806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.900580 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dc606-43fd-4e00-8f49-c363c4057770 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.922257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1058/2127] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:08.928626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:08.942212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376574d-9528-48ff-9010-f67a18a701af admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.949489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.950997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.951455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.951898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] PATH_INFO: `/v3/projects/c4a47d1fbb4f41efa8ccb373b1670299/users/fa6a68c2a9c144c1ac9a2c9ccb57514b/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.972026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a47d1fbb4f41efa8ccb373b1670299, user_id=fa6a68c2a9c144c1ac9a2c9ccb57514b, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.974977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.995492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1070/2128] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:08 2022] PUT /identity/v3/projects/c4a47d1fbb4f41efa8ccb373b1670299/users/fa6a68c2a9c144c1ac9a2c9ccb57514b/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:09.015447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.015993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.017506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.060002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] MFA Rules not processed for user `fa6a68c2a9c144c1ac9a2c9ccb57514b`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:09.061674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:09.108678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.111240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:09.189242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1059/2129] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:09.204854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.206451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:09.222139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:09.247070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530348f0-3f1f-4b1a-8956-29a6a66c00dc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.255676 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.256323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.256607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.256909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] PATH_INFO: `/v3/projects/0d5c2910b39741a9b70b05024db8c6cf` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.258560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5c2910b39741a9b70b05024db8c6cf)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.260482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:09.292529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f5f4-9212-424e-b55d-d3cd74a7d9f0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.297196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.297875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.298209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.298538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.307857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.309428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c921ea3-904c-43d7-9ae9-7363b6fc781a service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:09.325186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1060/2130] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:09.327319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5c2910b39741a9b70b05024db8c6cf', 'request_id': 'req-d0f9b888-f97e-47cb-b688-bbbfc58dc830'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:09.338982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5c2910b39741a9b70b05024db8c6cf', 'request_id': 'req-d0f9b888-f97e-47cb-b688-bbbfc58dc830'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:09.364696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5c2910b39741a9b70b05024db8c6cf', 'request_id': 'req-d0f9b888-f97e-47cb-b688-bbbfc58dc830'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:09.382237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] The token cache is being invalidate because project 0d5c2910b39741a9b70b05024db8c6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:09.382574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:09.383283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d0f9b888-f97e-47cb-b688-bbbfc58dc830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:09.394103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.394103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.394549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.398211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1071/2131] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:09 2022] DELETE /identity/v3/projects/0d5c2910b39741a9b70b05024db8c6cf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:09.437436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:09.440927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:09.597287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:09.627498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.627912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.628258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.632336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1061/2132] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:09.670130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:09.671384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:09.690478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1072/2133] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:09.691348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.701080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f447b-5ffa-4ef7-ae98-370cb57cba3b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.706293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.707000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.707356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.707798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.708458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:09.708796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.710521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:09.732825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1062/2134] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:09.733985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.745173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaa733-9f79-4026-826c-3b01f16726dd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.761961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.763152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.763957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.764538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.765844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.770060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:09.834387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1073/2135] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:09 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:09.839188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.863803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b15a1-f83d-49c4-89ae-3493fc920185 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.940000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.940743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.941154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.941560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.942308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.944449 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:09.972246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1063/2136] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:09 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:09.973598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:09.984433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fc4d-4eb1-4f0c-8d68-05208736a243 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:09.989809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:09.990447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:09.990687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:09.990957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:09.991600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:09.993235 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:10.004524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1074/2137] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:10.008455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:10.019259 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ca1c3-b10d-4d7e-ad1d-f14261845553 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:10.024534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:10.025231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.025512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.025785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.026436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:10.028053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce099056-b9b9-4c20-9bdb-84cb00974f30 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:10.040272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1064/2138] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:10.044597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:10.058865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1699-1451-4f52-8733-6450522ef73a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:10.065341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:10.066132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.066564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.066950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] PATH_INFO: `/v3/projects/00662db78d384291a5ad30e5172cae82/users/3b644cbc4602495aa07467d028ba940e/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.085311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00662db78d384291a5ad30e5172cae82, user_id=3b644cbc4602495aa07467d028ba940e, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:10.088100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:10.106900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1075/2139] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:10 2022] PUT /identity/v3/projects/00662db78d384291a5ad30e5172cae82/users/3b644cbc4602495aa07467d028ba940e/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:10.117011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.117594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.117692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.158067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] MFA Rules not processed for user `3b644cbc4602495aa07467d028ba940e`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:10.160567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:10.249892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1065/2140] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:10.262287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:10.265617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:10.346627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7d54-1920-4610-8532-12a17c7ddcd3 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:10.350412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:10.351022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.351301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.351586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.368115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:10.369511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:10.383691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1076/2141] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:14.366010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:14.368039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:14.456870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:14.472937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbcdbe-209a-4433-828b-19df67553b36 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:14.477798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:14.478446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:14.478727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:14.479004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] PATH_INFO: `/v3/users/badb3837c71e4274b1868a3d0d2dfa82` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:14.480218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=badb3837c71e4274b1868a3d0d2dfa82)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:14.482274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:14.548446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badb3837c71e4274b1868a3d0d2dfa82'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:14.559959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badb3837c71e4274b1868a3d0d2dfa82'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:14.560982 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badb3837c71e4274b1868a3d0d2dfa82'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:14.561814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badb3837c71e4274b1868a3d0d2dfa82'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:14.577623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b4062ee5-29d2-45ce-9a88-3533f929fe7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badb3837c71e4274b1868a3d0d2dfa82'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:14.598460 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1066/2142] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:14 2022] DELETE /identity/v3/users/badb3837c71e4274b1868a3d0d2dfa82 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:14.845312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:14.864326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234d355-96e1-4647-bcd5-23b44c8fe9b2 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:14.890325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:14.977225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:14.977868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:14.978374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:14.978657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] PATH_INFO: `/v3/projects/a0d1426bbd1a40e0bd11014d34476324` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:14.980697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d1426bbd1a40e0bd11014d34476324)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:14.983035 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.058688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d1426bbd1a40e0bd11014d34476324', 'request_id': 'req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:15.069172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d1426bbd1a40e0bd11014d34476324', 'request_id': 'req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:15.081051 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d1426bbd1a40e0bd11014d34476324', 'request_id': 'req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:15.119982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] The token cache is being invalidate because project a0d1426bbd1a40e0bd11014d34476324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:15.120320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:15.121076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-20df88cd-ff14-4b26-8d01-52b2d6e34a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:15.123140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1077/2143] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:14 2022] DELETE /identity/v3/projects/a0d1426bbd1a40e0bd11014d34476324 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:15.129967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.130246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.130553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.161450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:15.162861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.311600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.311869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1067/2144] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:15.312057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.312337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.343829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:15.345866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.364806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1078/2145] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:15.369394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.385389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b6a4-4557-4f77-9226-e873ff31dbe7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.393868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.394802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.394933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.395421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.396542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:15.397086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.400988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.421517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1068/2146] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:15.428032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.451002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff7796-bbdf-444a-8d7e-1628966cb1ed None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.459757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.461428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.461938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.462479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.463372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.467134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.510656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1079/2147] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:15.515776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.530390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7a2a-5b5c-4e26-972d-a8e168d26bcb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.616873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.617741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.618172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.618655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.619749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.623099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.634860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:15.658277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1069/2148] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:15.664326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.677090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931626-ea05-4a3b-b5af-79b987c207d7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.682033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.682801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.683174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.683541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.684306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.686150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.706738 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1080/2149] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:15.707937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.729426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cc61-64f6-47e9-8f91-8354b505abc8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.734435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.735223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.735633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.735878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.736533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.739231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b9f-26d9-4e27-b075-b15fab937e11 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.760860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1070/2150] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:15.762228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.777013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5622e8-6e98-4454-8c12-abc0aa5e4907 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.782623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.783880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.784241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.784588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] PATH_INFO: `/v3/projects/8f6b9e5d3c9a42d0b07491fed3bf339b/users/e954a59593cc4352a42d228d72cd47fd/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.819852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6b9e5d3c9a42d0b07491fed3bf339b, user_id=e954a59593cc4352a42d228d72cd47fd, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.826997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.857411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1081/2151] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:15 2022] PUT /identity/v3/projects/8f6b9e5d3c9a42d0b07491fed3bf339b/users/e954a59593cc4352a42d228d72cd47fd/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:15.865550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe798a6-4400-4815-b1ea-7d0efa634955 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.866373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe798a6-4400-4815-b1ea-7d0efa634955 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.866791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe798a6-4400-4815-b1ea-7d0efa634955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.901625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0fe798a6-4400-4815-b1ea-7d0efa634955 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:15.903104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0fe798a6-4400-4815-b1ea-7d0efa634955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.981840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1071/2152] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:15.992921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.994913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:16.071200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:16.090649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bfcf9-aac9-4585-b28e-7d8e4d884493 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:16.097469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:16.098428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:16.098882 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:16.099322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:16.114268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:16.115820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:16.126973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1082/2153] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:22.518101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443a75-487b-4c66-9ac4-00e302ec9077 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:22.518951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443a75-487b-4c66-9ac4-00e302ec9077 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:22.519506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a443a75-487b-4c66-9ac4-00e302ec9077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:22.705693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2a443a75-487b-4c66-9ac4-00e302ec9077 None None] MFA Rules not processed for user `e954a59593cc4352a42d228d72cd47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:22.711198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a443a75-487b-4c66-9ac4-00e302ec9077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:22.877311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:22.879718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:22.926155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1dd97-772b-4d84-9baf-eeed38abb718 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:22.947117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:22.950516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:22.958150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:22.958864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] PATH_INFO: `/v3/users/fa6a68c2a9c144c1ac9a2c9ccb57514b` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:22.962059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6a68c2a9c144c1ac9a2c9ccb57514b)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:22.972969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:22.989504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1072/2154] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:23.002853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.011138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.011508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.059868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] MFA Rules not processed for user `e954a59593cc4352a42d228d72cd47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:23.063992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.102155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1073/2155] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:23.122728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:23.123997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.146228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6a68c2a9c144c1ac9a2c9ccb57514b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:23.147130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6a68c2a9c144c1ac9a2c9ccb57514b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:23.160444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6a68c2a9c144c1ac9a2c9ccb57514b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:23.188935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6a68c2a9c144c1ac9a2c9ccb57514b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:23.202887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce6878f8-3369-481b-9aa2-318e93b7745a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6a68c2a9c144c1ac9a2c9ccb57514b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:23.216057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1083/2156] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:22 2022] DELETE /identity/v3/users/fa6a68c2a9c144c1ac9a2c9ccb57514b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:23.218089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.218614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.219536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.245795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:23.247594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.281839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:23.318135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782c6b6-ceb0-4b37-9647-d015f80c9743 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:23.387268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1084/2157] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:23.397872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:23.399560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.492162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f475-df07-4d0c-9045-eb04c09251f8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:23.494067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:23.494819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.495157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.495554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.497622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.498201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:23.499216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.499570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.499998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.515139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:23.518817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb906c-6e26-4c0b-8c56-7309390d9e82 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:23.538029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1085/2158] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:23.607157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:23.611754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:23.635790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1074/2159] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:24.253411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:24.254671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:24.255578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:24.268325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:24.271331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.285582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:24.340812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cea3b9-c4c9-47cd-9606-1160c5f9b44d service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:24.348606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:24.350633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.358764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:24.359671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:24.361892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:24.362189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] PATH_INFO: `/v3/projects/c4a47d1fbb4f41efa8ccb373b1670299` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:24.377532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a47d1fbb4f41efa8ccb373b1670299)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:24.381317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:24.530268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a47d1fbb4f41efa8ccb373b1670299', 'request_id': 'req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.540680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a47d1fbb4f41efa8ccb373b1670299', 'request_id': 'req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.551158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1086/2160] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:24.558363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:24.560250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a47d1fbb4f41efa8ccb373b1670299', 'request_id': 'req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.565155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.583106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] The token cache is being invalidate because project c4a47d1fbb4f41efa8ccb373b1670299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:24.583637 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.585296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bbcfa0d1-0bf5-4b9f-925b-012199ff8dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.587687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1075/2161] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:24 2022] DELETE /identity/v3/projects/c4a47d1fbb4f41efa8ccb373b1670299 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:24.591880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d171-b861-42fc-b68f-2a71515c9b51 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:24.596681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:24.597144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:24.597588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:24.682017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:24.684408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.714563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:24.762690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:24.764255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:24.764638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:24.766938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] PATH_INFO: `/v3/users/d0ddc2b236a6442e96682f9945c895ff` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:24.768991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ddc2b236a6442e96682f9945c895ff)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:24.772284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:24.815755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1076/2162] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:24.815755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:24.817557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.899018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ddc2b236a6442e96682f9945c895ff'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.900530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ddc2b236a6442e96682f9945c895ff'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.918158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ddc2b236a6442e96682f9945c895ff'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.987423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ddc2b236a6442e96682f9945c895ff'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:24.994681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde279-eb6d-4c34-bfc0-ba4df6c2f9e6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:25.004515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:25.005834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.006291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.006734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.018560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:25.047463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f8f5f921-fd16-4cb0-87c9-bd82bc56446a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ddc2b236a6442e96682f9945c895ff'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:25.069077 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1087/2163] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:24 2022] DELETE /identity/v3/users/d0ddc2b236a6442e96682f9945c895ff => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:25.079942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add6a7-bc1c-421d-b64d-63c6187f6144 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.082007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add6a7-bc1c-421d-b64d-63c6187f6144 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.082398 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add6a7-bc1c-421d-b64d-63c6187f6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.128632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-96add6a7-bc1c-421d-b64d-63c6187f6144 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:25.130231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-96add6a7-bc1c-421d-b64d-63c6187f6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:25.181102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:25.228084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:25.237707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbe656-b0c0-4175-a301-4f8511552ce2 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:25.260652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1077/2164] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:45:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:45:25.263245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.264041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.264463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.290338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1088/2165] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:25.291687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.294290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.294692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.322235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:25.325653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:25.354656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1078/2166] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:25.356374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:25.361705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] MFA Rules not processed for user `e954a59593cc4352a42d228d72cd47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:25.370771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:25.393305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4fb04-d7b3-45a8-b8fe-8dc90c366b1b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:25.405971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:25.407182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.407714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.408098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.409718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:25.410233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:25.414125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:25.440959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1079/2167] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:45:25.442682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:25.445608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:25.545821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1089/2168] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:25.548791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:25.555943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:25.579180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911435c1-5c7a-444f-963e-fded9d8dcca4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:25.585959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:25.587469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.588192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.589271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.598893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40f2d2-656b-4bd1-a742-29157885557d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:25.614196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:25.620035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:25.621347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:25.625053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.628021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.630236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.632586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:25.641511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:25.666385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1080/2169] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:25.712394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1090/2170] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:25 2022] POST /identity/v3/projects => generated 397 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:25.721366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:25.742152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4d360-6361-4416-a15c-45337053b250 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:25.924435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:25.925639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:25.926157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:25.926518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:25.927515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:25.930501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:25.975547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1081/2171] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:25 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:25.981277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:26.012853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55622ffd-695f-480b-bc61-fc2441c5e808 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:26.034703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:26.035119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:26.035608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:26.036083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:26.042762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:26.046333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:26.071487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1091/2172] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:26.073315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:26.126831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18d10-2e1e-4762-9887-cb588301d251 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:26.162861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:26.163257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:26.163587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:26.165558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:26.166899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:26.170070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597db00-e47c-4f5c-8992-004b4dbff13a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:26.271289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1082/2173] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:26.273226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:26.306548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017d08-92c8-48f6-b1df-d1e577ac7bb1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:26.339071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:26.340447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:26.341079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:26.341836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] PATH_INFO: `/v3/projects/d38c2e3c80854f8bbbd76e1af5eb3354/users/2201f670ef7442cd80a576fada19f044/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:26.400475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38c2e3c80854f8bbbd76e1af5eb3354, user_id=2201f670ef7442cd80a576fada19f044, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:26.408435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:26.474489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1092/2174] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:26 2022] PUT /identity/v3/projects/d38c2e3c80854f8bbbd76e1af5eb3354/users/2201f670ef7442cd80a576fada19f044/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:26.494885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:26.495480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:26.496722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:26.604409 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] MFA Rules not processed for user `2201f670ef7442cd80a576fada19f044`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:26.616104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:26.862941 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:26.866504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:26.905271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1083/2175] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:26.933925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:26.937530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.132278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6f06-a3ee-4581-abb6-29fcde77651b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:27.143666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:27.144794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.145481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.146276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] PATH_INFO: `/v3/projects/4fd4aeb30868416b88c17580321f49dc` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.148686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd4aeb30868416b88c17580321f49dc)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:27.152421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:27.164009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe470c-6987-4a78-8c84-107152c34e75 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:27.170480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:27.171712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.172369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.173044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.192829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:27.204675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:27.209222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe5f43-de72-45f8-b481-c8c4bbf1e031 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:27.240650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:27.267661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1084/2176] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:27.272692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.273558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.275177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.325051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:27.328806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.366965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd4aeb30868416b88c17580321f49dc', 'request_id': 'req-0976ee39-80dd-4c75-8e17-6b495056f3d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:27.398299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd4aeb30868416b88c17580321f49dc', 'request_id': 'req-0976ee39-80dd-4c75-8e17-6b495056f3d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:27.425901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd4aeb30868416b88c17580321f49dc', 'request_id': 'req-0976ee39-80dd-4c75-8e17-6b495056f3d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:27.441535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1085/2177] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:27.441861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:27.445971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.475663 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] The token cache is being invalidate because project 4fd4aeb30868416b88c17580321f49dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:27.476167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:27.479819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0976ee39-80dd-4c75-8e17-6b495056f3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:27.484652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1093/2178] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:26 2022] DELETE /identity/v3/projects/4fd4aeb30868416b88c17580321f49dc => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:27.492290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.493116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.493828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.553412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:27.557654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.579644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930cbd9-2f68-47f1-9004-f2963f272b6b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:27.594769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:27.597119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.601910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.602922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.606759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.652921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:27.657324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2ed2a-a166-405a-8dee-727092d1fec2 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:27.682712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1086/2179] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:45:27.795026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1094/2180] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:27.804717 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.805162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.805441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:27.887238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:27.893502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:27.958994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1087/2181] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:27.961761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:27.977052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec6d69-94c1-4297-b734-f1e6ef33c000 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:27.988511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:27.993113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:27.997193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:27.997193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.001162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:28.003664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:28.011418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:28.077125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1095/2182] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:45:28.079305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:28.106344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05900b-9380-475c-8e51-92b78cd518c4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:28.124931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:28.128217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:28.129051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:28.129486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.130881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:28.133701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05b7c-7982-4006-9813-567a3f7c5a4f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:28.226773 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1088/2183] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:28 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:28.229741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:28.285335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c561f0-b307-42a4-b33f-69121ae3b66d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:28.431819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:28.433878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:28.434254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.529200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:28.532315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:28.644861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:28.649359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:28.649900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:28.650397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.651629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:28.670958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:28.766983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1096/2184] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:28 2022] POST /identity/v3/users => generated 288 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:28.772924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:28.775114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1089/2185] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:28.795870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:28.799657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:28.805195 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a910-6808-492c-ba39-ba67b671aaf8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:28.820518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:28.828982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:28.832358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:28.832886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:28.833344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.834455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:28.853765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:28.910856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1097/2186] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:28.916435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:28.954894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201b15b-deff-4a2a-9586-6bd304772601 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:28.976606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:28.978026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:28.978445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:28.978889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:28.980064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:28.986464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:29.013534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:29.040849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1098/2187] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:29.040849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:29.076226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062ee5f-4ed2-40b0-afff-2d492f3f6378 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:29.087797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2dda5-94d5-4ded-9b41-bb623f9eee40 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:29.097328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:29.098662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.099226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.100945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] PATH_INFO: `/v3/projects/7bf2a260f23049178aae40bda380a4e9/users/91c4e584cb0f4feca6d047e99b77df10/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.118021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:29.118831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.119111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.119386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.147492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:29.149433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb3aab-9e74-4209-b47b-d97cdc530714 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:29.160958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf2a260f23049178aae40bda380a4e9, user_id=91c4e584cb0f4feca6d047e99b77df10, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:29.166430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:29.169932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1090/2188] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:45:29.212671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1099/2189] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:29 2022] PUT /identity/v3/projects/7bf2a260f23049178aae40bda380a4e9/users/91c4e584cb0f4feca6d047e99b77df10/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:29.235677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafa85-a8b4-4304-abe2-34f3c68826be None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.235923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafa85-a8b4-4304-abe2-34f3c68826be None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.236150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecafa85-a8b4-4304-abe2-34f3c68826be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.390293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6ecafa85-a8b4-4304-abe2-34f3c68826be None None] MFA Rules not processed for user `91c4e584cb0f4feca6d047e99b77df10`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:29.392358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6ecafa85-a8b4-4304-abe2-34f3c68826be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:29.630475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1091/2190] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:29.647154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:29.650844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:29.874579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8a892-3e1c-41cd-bb86-12c219e1ae40 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:29.889850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:29.891600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.892089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.892591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.912408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:29.915556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:29.933744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1100/2191] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:30.199839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:30.200908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:30.201214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:30.280447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:30.284697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:30.478324 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1092/2192] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:45:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:30.507185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:30.851415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:30.854954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:30.863679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f74501-5a73-48af-92b3-ca3b941cac8d service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:30.891249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:30.902753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:30.902753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:30.908298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:30.951727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:30.955981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a92b7-88e8-404a-bae1-ecb3fb6f092f service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:31.001822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:31.016862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1101/2193] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:45:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:45:31.147708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f93dd-f7fd-404f-a5c2-103e1678d595 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:31.169374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:31.173423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:31.175457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:31.175913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] PATH_INFO: `/v3/users/3b644cbc4602495aa07467d028ba940e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:31.179948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b644cbc4602495aa07467d028ba940e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:31.182066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:31.329171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b644cbc4602495aa07467d028ba940e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:31.345619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b644cbc4602495aa07467d028ba940e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:31.347855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b644cbc4602495aa07467d028ba940e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:31.349805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b644cbc4602495aa07467d028ba940e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:31.374557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b644cbc4602495aa07467d028ba940e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:31.406545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1093/2194] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:30 2022] DELETE /identity/v3/users/3b644cbc4602495aa07467d028ba940e => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:31.414224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:31.414638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:31.415678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:31.456747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:31.458740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:31.597256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1102/2195] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:31.619698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:31.622019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:31.877866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e7b27-6f7c-4014-bad2-11201424f1db admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:31.898712 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:31.900508 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:31.901030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:31.902992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:31.948081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:31.967501 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cc462-5366-41da-a22f-64db7d3b0978 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:32.026737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1094/2196] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:32.574639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:32.578046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:32.606239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c31ef-49ad-4828-99fd-1868d86d0e47 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:32.618972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:32.632032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:32.632352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:32.634019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] PATH_INFO: `/v3/projects/00662db78d384291a5ad30e5172cae82` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:32.639888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00662db78d384291a5ad30e5172cae82)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:32.646511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:32.661923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:32.830716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00662db78d384291a5ad30e5172cae82', 'request_id': 'req-610e55a4-756c-4073-aca3-f9eb0aaa651a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:32.851700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00662db78d384291a5ad30e5172cae82', 'request_id': 'req-610e55a4-756c-4073-aca3-f9eb0aaa651a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:32.880544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00662db78d384291a5ad30e5172cae82', 'request_id': 'req-610e55a4-756c-4073-aca3-f9eb0aaa651a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:32.915698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] The token cache is being invalidate because project 00662db78d384291a5ad30e5172cae82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:32.916364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:32.921655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-610e55a4-756c-4073-aca3-f9eb0aaa651a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:32.925005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1103/2197] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:32 2022] DELETE /identity/v3/projects/00662db78d384291a5ad30e5172cae82 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:32.932934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:32.933606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:32.934236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.009593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:33.012506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:33.152830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:33.205480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1095/2198] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:33.231862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.232678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.233468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.309900 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:33.311876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:33.324556 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1104/2199] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:33.332090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:33.373959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c17fe2-b14b-436e-b9ff-21e7f51226bb None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:33.400395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:33.401352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.401641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.406093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.409085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:33.409806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:33.412530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:33.444821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1096/2200] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:33.451949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:33.473462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc26713-6baa-4e45-8d3d-d8ec67f46879 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:33.479437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:33.480167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.480329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.480816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.482206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:33.488588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:33.575529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1105/2201] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:33 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:33.578797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:33.599694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf172b50-2b97-4d6a-9036-2ad596d694f3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:33.782341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:33.784264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.793200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.793200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.793200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:33.816895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:33.864572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1097/2202] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:33 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:33.865704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:33.880964 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770345-4521-4312-ace9-f3a5020ae04b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:33.892146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:33.892843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.893329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.894197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.896347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:33.900053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:33.940935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1106/2203] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:33.945950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:33.964099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e00b27-d87f-4f97-a031-b3a72864f19a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:33.989535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:33.992704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.993678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.994437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.995893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:34.002212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709ad57-2279-47a9-9e57-9231b5771d11 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:34.027598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1098/2204] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:34.039649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:34.078276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28d7d9-ff3b-4821-88de-06aaa61c2f30 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:34.113958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:34.121028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:34.122054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:34.122829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] PATH_INFO: `/v3/projects/08b186c3bca64bca91869fba7dd96890/users/a7c115b21606435c8e2dd5ac8e70df3e/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:34.178282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b186c3bca64bca91869fba7dd96890, user_id=a7c115b21606435c8e2dd5ac8e70df3e, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:34.184867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:34.245922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1107/2205] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:34 2022] PUT /identity/v3/projects/08b186c3bca64bca91869fba7dd96890/users/a7c115b21606435c8e2dd5ac8e70df3e/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:34.258369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:34.258871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:34.259343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:34.323491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] MFA Rules not processed for user `a7c115b21606435c8e2dd5ac8e70df3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:34.325076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:34.419657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1099/2206] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:34.465205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:34.465205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:34.552232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce266c-fedc-4b74-a3cd-0a13b9bafa37 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:34.560095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:34.561581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:34.562350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:34.563620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:34.619311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:34.627065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a14df-24a8-4dfc-84d9-da8173e1a0bb service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:34.660109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1108/2207] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:34.662056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:34.664518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:34.748294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:34.789349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82377466-a618-42d0-9bd4-7465a4df3072 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:34.797947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:34.799023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:34.799314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:34.799577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] PATH_INFO: `/v3/users/2201f670ef7442cd80a576fada19f044` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:34.801200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2201f670ef7442cd80a576fada19f044)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:34.805916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:34.918725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2201f670ef7442cd80a576fada19f044'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:34.934881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2201f670ef7442cd80a576fada19f044'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:34.936134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2201f670ef7442cd80a576fada19f044'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:34.937319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2201f670ef7442cd80a576fada19f044'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:34.961916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2201f670ef7442cd80a576fada19f044'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:34.984267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1100/2208] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:34 2022] DELETE /identity/v3/users/2201f670ef7442cd80a576fada19f044 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:34.989703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:34.990231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:34.991540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.035552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:35.037687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.099734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:35.188603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1109/2209] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:35.210567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:35.214443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.369062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f980f-800f-465f-b7bf-d49941a17c65 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:35.377123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:35.378158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:35.378633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:35.379770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.399351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:35.401942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32421fc8-1988-4865-a140-e524f810d71a service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:35.415654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1101/2210] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:35.548184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:35.551399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.579656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f874fb-0e17-45c4-940a-5c9cd153d2e7 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:35.588837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:35.590483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:35.591237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:35.591714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] PATH_INFO: `/v3/users/571ffe0e364e490a8e95accfdfb4f24f` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.594923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571ffe0e364e490a8e95accfdfb4f24f)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:35.599222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:35.695537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571ffe0e364e490a8e95accfdfb4f24f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:35.698071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571ffe0e364e490a8e95accfdfb4f24f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:35.712892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571ffe0e364e490a8e95accfdfb4f24f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:35.743055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571ffe0e364e490a8e95accfdfb4f24f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:35.761339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571ffe0e364e490a8e95accfdfb4f24f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:35.780305 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1110/2211] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:35 2022] DELETE /identity/v3/users/571ffe0e364e490a8e95accfdfb4f24f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:35.786643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:35.786926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:35.787213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.819577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:35.821026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.898916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:35.900600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.947752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1102/2212] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:35.960945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:35.962417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:36.002600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:36.060569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42553da-e394-43a8-9a00-d1484cf5c835 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:36.083082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:36.083367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a2d97-5e94-4106-b9f1-ca12bf4e58d1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:36.084360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.085098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.085374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] PATH_INFO: `/v3/projects/d38c2e3c80854f8bbbd76e1af5eb3354` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.089311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:36.090479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.090919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.091458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.098700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38c2e3c80854f8bbbd76e1af5eb3354)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:36.102641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:36.115523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:36.118878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bad631-3430-4f08-8768-cf678e1b5447 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:36.159803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1103/2213] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:36.216623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:36.222369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38c2e3c80854f8bbbd76e1af5eb3354', 'request_id': 'req-33a5274c-fc2a-4ae4-a94b-213011c3cd77'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.244700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38c2e3c80854f8bbbd76e1af5eb3354', 'request_id': 'req-33a5274c-fc2a-4ae4-a94b-213011c3cd77'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.259096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38c2e3c80854f8bbbd76e1af5eb3354', 'request_id': 'req-33a5274c-fc2a-4ae4-a94b-213011c3cd77'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.284437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] The token cache is being invalidate because project d38c2e3c80854f8bbbd76e1af5eb3354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:36.285031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.286143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-33a5274c-fc2a-4ae4-a94b-213011c3cd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.289180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1111/2214] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:35 2022] DELETE /identity/v3/projects/d38c2e3c80854f8bbbd76e1af5eb3354 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:36.299275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.299961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.300855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.331398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:36.333187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:36.453036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1104/2215] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:36.463937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.464382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.465163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.484181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:36.488185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:36.515991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa4e29-2564-46d3-af41-923062801f38 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:36.522855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:36.524120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:36.540559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1112/2216] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:36.541844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:36.552564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:36.553521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.553898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.554109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1cc44-c323-4474-abcf-ea50717373e2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:36.554231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] PATH_INFO: `/v3/projects/58ec80a9502847d4a6d896269098a529` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.555819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ec80a9502847d4a6d896269098a529)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:36.558371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:36.565093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:36.568659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.569175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.569657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.570847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:36.571375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:36.575478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:36.604985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1113/2217] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:45:36.610644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:36.639779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867e454-c410-4e6b-b389-cffc38f32313 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:36.661762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ec80a9502847d4a6d896269098a529', 'request_id': 'req-6e2576ec-83b5-411f-9f86-3be5e1d08c02'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.685047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ec80a9502847d4a6d896269098a529', 'request_id': 'req-6e2576ec-83b5-411f-9f86-3be5e1d08c02'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.706774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ec80a9502847d4a6d896269098a529', 'request_id': 'req-6e2576ec-83b5-411f-9f86-3be5e1d08c02'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.731380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] The token cache is being invalidate because project 58ec80a9502847d4a6d896269098a529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:36.731971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.733045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:36.735728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1105/2218] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:36 2022] DELETE /identity/v3/projects/58ec80a9502847d4a6d896269098a529 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:36.803040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:36.804121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:36.807877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:36.808200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:36.808936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:36.817369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:36.920034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1114/2219] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:36 2022] POST /identity/v3/projects => generated 371 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:36.923778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:36.928013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:36.973140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2576ec-83b5-411f-9f86-3be5e1d08c02 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.085190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:37.138839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.139649 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.140050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.140476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.141526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.145007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:37.180700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1106/2220] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:36 2022] POST /identity/v3/users => generated 286 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:37.185552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:37.198779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75f7f6-d783-4e55-8f48-5be7aff3397f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.204960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.205927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.206380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.206820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.207719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.209452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:37.227227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1115/2221] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:37.231895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:37.248737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0614a2f-2146-45a5-97f1-c4d856570419 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.255516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.256183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.256555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.256936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.257722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.259564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca4206-a027-4fdc-88fd-1f693b8b6d1a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:37.273798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1107/2222] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:45:37.280069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:37.292085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c14e3-121e-46bc-ba9c-18fe66681d0c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.297715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.298525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.298935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.299452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] PATH_INFO: `/v3/projects/532877f7e1904db991154a0fce5e86f4/users/18046792a7424f068c89a42d9d0ac332/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.318455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532877f7e1904db991154a0fce5e86f4, user_id=18046792a7424f068c89a42d9d0ac332, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.322268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:37.338888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1116/2223] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:37 2022] PUT /identity/v3/projects/532877f7e1904db991154a0fce5e86f4/users/18046792a7424f068c89a42d9d0ac332/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:37.345797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.346835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.347303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.368629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:37.370103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:37.452646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1108/2224] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:37.467098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:37.470221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:37.564000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f8d15-f5b0-45b0-ac76-16b3d79c3258 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.570805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.571815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.572304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.572796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.590151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.592171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638185-3a32-4887-925b-4f2cc0d4e479 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:37.611544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1117/2225] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:37.931936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:37.936203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:37.967114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2e782-f56b-4741-899b-a3c6712af562 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:37.976261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:37.977367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:37.978088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:37.978559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] PATH_INFO: `/v3/users/a7c115b21606435c8e2dd5ac8e70df3e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:37.980529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c115b21606435c8e2dd5ac8e70df3e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:37.984466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:38.094114 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c115b21606435c8e2dd5ac8e70df3e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:38.107095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c115b21606435c8e2dd5ac8e70df3e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:38.108408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c115b21606435c8e2dd5ac8e70df3e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:38.109124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c115b21606435c8e2dd5ac8e70df3e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:38.134156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c115b21606435c8e2dd5ac8e70df3e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:38.155894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1109/2226] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:37 2022] DELETE /identity/v3/users/a7c115b21606435c8e2dd5ac8e70df3e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:38.166701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:38.167262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:38.167395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:38.203043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:38.229336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:38.232893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:38.384034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1118/2227] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:38.407276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:38.416714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:38.501760 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:38.597801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890c7fc-f002-4e74-811b-be2f8912e56c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:38.605225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:38.606145 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:38.606624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:38.607241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:38.628813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:38.632341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:38.653276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1110/2228] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:40.163750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:40.167052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:40.209833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca76da8-899d-4ec6-bdaf-d108e35932f9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:40.240452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:40.240452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:40.240869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:40.240869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] PATH_INFO: `/v3/projects/08b186c3bca64bca91869fba7dd96890` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:40.246857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b186c3bca64bca91869fba7dd96890)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:40.251750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:40.431040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b186c3bca64bca91869fba7dd96890', 'request_id': 'req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:40.444298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b186c3bca64bca91869fba7dd96890', 'request_id': 'req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:40.458694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b186c3bca64bca91869fba7dd96890', 'request_id': 'req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:40.494629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] The token cache is being invalidate because project 08b186c3bca64bca91869fba7dd96890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:40.495108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:40.496335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-74bee65d-b7b6-4b0f-be2b-1f028ed469ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:40.501161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1119/2229] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:40 2022] DELETE /identity/v3/projects/08b186c3bca64bca91869fba7dd96890 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:44.594867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:44.596349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:44.626887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09feee6-4d91-4c19-821b-f1d5759bf39a service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:44.781888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:44.782814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:44.783293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:44.783753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] PATH_INFO: `/v3/users/91c4e584cb0f4feca6d047e99b77df10` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:44.785323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c4e584cb0f4feca6d047e99b77df10)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:44.788909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:44.885357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c4e584cb0f4feca6d047e99b77df10'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:44.900148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c4e584cb0f4feca6d047e99b77df10'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:44.901447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c4e584cb0f4feca6d047e99b77df10'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:44.902844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c4e584cb0f4feca6d047e99b77df10'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:44.932600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c4e584cb0f4feca6d047e99b77df10'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:44.969352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1111/2230] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:45:44 2022] DELETE /identity/v3/users/91c4e584cb0f4feca6d047e99b77df10 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:44.976532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ba26-ad33-4d6d-aa4d-cf70e1224a9e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:44.977497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ba26-ad33-4d6d-aa4d-cf70e1224a9e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:44.978286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2ba26-ad33-4d6d-aa4d-cf70e1224a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:45.045495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9aa2ba26-ad33-4d6d-aa4d-cf70e1224a9e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:45.047799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9aa2ba26-ad33-4d6d-aa4d-cf70e1224a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:45.220853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1120/2231] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:45.235308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:45.238835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:45.419197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7be99-c9ae-48da-8216-8261d72d143a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:45.428641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:45.429991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:45.431441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:45.432026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:45.442231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:45.454854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:45.457426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:45.472308 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1112/2232] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:46.088817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.090599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.091345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.105952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.108214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.141030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765909b-7264-49dc-9d78-14d27a00dd98 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.155587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.157011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.157396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.157998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] PATH_INFO: `/v3/projects/7bf2a260f23049178aae40bda380a4e9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.167660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] MFA Rules not processed for user `18046792a7424f068c89a42d9d0ac332`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:46.167930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.172614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf2a260f23049178aae40bda380a4e9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.176138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.195429 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:46.288577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf2a260f23049178aae40bda380a4e9', 'request_id': 'req-51e65d9f-62bf-4457-a39a-dba4c6d7553b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:46.295829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf2a260f23049178aae40bda380a4e9', 'request_id': 'req-51e65d9f-62bf-4457-a39a-dba4c6d7553b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:46.299805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1121/2233] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:46.306334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.308015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.309644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf2a260f23049178aae40bda380a4e9', 'request_id': 'req-51e65d9f-62bf-4457-a39a-dba4c6d7553b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:46.330940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9829b75-1ca2-4b20-95a3-7c53ff1b2626 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.337406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] The token cache is being invalidate because project 7bf2a260f23049178aae40bda380a4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:45:46.338512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:46.340317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51e65d9f-62bf-4457-a39a-dba4c6d7553b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:45:46.342603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1113/2234] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:45:46 2022] DELETE /identity/v3/projects/7bf2a260f23049178aae40bda380a4e9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:46.349761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30f97-b79f-4917-81db-d0aebdc8d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.351162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30f97-b79f-4917-81db-d0aebdc8d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.351627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30f97-b79f-4917-81db-d0aebdc8d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.383605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-80e30f97-b79f-4917-81db-d0aebdc8d3a0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:46.386339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-80e30f97-b79f-4917-81db-d0aebdc8d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.432691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.433529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.433887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.434222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.434960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.437703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.488094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1122/2235] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:46.504935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1114/2236] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:46.505095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.505095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.509290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.509881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.510340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.553822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:46.555972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.611498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e7fea-c29a-4a77-9d93-d6c62b2d851c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.616736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.617531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.617897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.618244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.619543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.621627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.657020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1115/2237] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:46.660923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1123/2238] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:46.661922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.663187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.673219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3814033-ae37-41b0-91f6-4ab65c19b8e8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.676701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dbf15-dd7e-47d4-849a-73696c0b6cfb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.678373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.678992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.679274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.679547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.680194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.681868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.685480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.686529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.686978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.688186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.689388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:45:46.690008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.692056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.693735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1116/2239] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:46.697726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.710641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55713195-ac93-4fec-8d15-a93cd0d62467 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.712226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1124/2240] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:45:46.716750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.718744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.719875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.720354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.720874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] PATH_INFO: `/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b/users/9fd55f6b0b8f4db7baba304f6161966e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.725051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:46.730675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63839b9-74f5-4a8b-8911-1ea201e92958 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.738336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.738336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.738336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.738336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.739960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.744024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.748892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b062795b9b84c49a8b0b900a98b0b2b, user_id=9fd55f6b0b8f4db7baba304f6161966e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.754416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.776432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:46.781625 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1117/2241] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:46 2022] PUT /identity/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b/users/9fd55f6b0b8f4db7baba304f6161966e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:46.785871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.789680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1125/2242] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:45:46.795466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.914279 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed8f11-3971-4317-b922-e67d116fd62c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.922078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.923068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.923675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.924086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.925185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.925358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d0be5-36e9-4fd3-8b1b-a0af908086c9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.930976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.936797 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.938364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.938849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.939331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.940523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.943787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.965201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1118/2243] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:46.972626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.989675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1126/2244] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:45:46 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:45:46.994588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.996366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bd9c4-2673-442d-b6ba-b92ced6f68f8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:47.005535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:47.007885 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.008385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.009048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] PATH_INFO: `/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b/users/9fd55f6b0b8f4db7baba304f6161966e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.011311 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c416b-7b28-4a26-b903-f2f31fc61133 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:47.015932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b062795b9b84c49a8b0b900a98b0b2b, user_id=9fd55f6b0b8f4db7baba304f6161966e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:47.019402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:47.020121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:47.021124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.021349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.021641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.022303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:47.024252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:47.040202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1119/2245] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:46 2022] PUT /identity/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b/users/9fd55f6b0b8f4db7baba304f6161966e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:45:47.056662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1127/2246] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:47.058706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:47.206175 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104615-eca2-48b3-b5d8-0d661b5f0477 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:47.216910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:47.217549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.217830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.218106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.221431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:47.223850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82276b-9a0f-4b16-9625-501f627863cb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:47.260080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1120/2247] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:45:47.267798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:47.318525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77041ef5-03fd-45cc-99dc-950be6626d88 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:47.349989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:47.350861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.352998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.353512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] PATH_INFO: `/v3/projects/1fb40eecae544291aef664ce1c50db28/users/7bcadfc46a5940279e557de306f933e3/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.430605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb40eecae544291aef664ce1c50db28, user_id=7bcadfc46a5940279e557de306f933e3, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:47.435336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:47.458721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1128/2248] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:45:47 2022] PUT /identity/v3/projects/1fb40eecae544291aef664ce1c50db28/users/7bcadfc46a5940279e557de306f933e3/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:45:47.465419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664416d-41e0-4774-a36a-2b6bfcf7cc07 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.467524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664416d-41e0-4774-a36a-2b6bfcf7cc07 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.467971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664416d-41e0-4774-a36a-2b6bfcf7cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.512993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c664416d-41e0-4774-a36a-2b6bfcf7cc07 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:47.516026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c664416d-41e0-4774-a36a-2b6bfcf7cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:47.739322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1121/2249] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:47.751645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:47.755334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:47.879638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d5ae3-9482-4f32-ba06-895235d6d192 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:47.887958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:47.889025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.889566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.890056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.911197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:47.915722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:47.938842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1129/2250] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:49.854860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed5bf-22e6-4d4f-88ae-e1b7be15044f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:49.855496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed5bf-22e6-4d4f-88ae-e1b7be15044f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:49.855800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bed5bf-22e6-4d4f-88ae-e1b7be15044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:49.877913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:49.950611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c0bed5bf-22e6-4d4f-88ae-e1b7be15044f None None] MFA Rules not processed for user `7bcadfc46a5940279e557de306f933e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:49.951891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c0bed5bf-22e6-4d4f-88ae-e1b7be15044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:50.152075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1122/2251] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:50.162694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:50.164939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:50.378351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ff06d-20ef-42e6-bfdb-44fd61ffc6ce service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:50.392704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:50.393582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:50.393962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:50.394358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:50.412144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:50.414446 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cb5be-2e06-4773-a409-3fdfe9c86ab6 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:50.424828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:50.434884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1130/2252] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:52.239397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:52.240159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:52.240159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:52.279665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] MFA Rules not processed for user `7bcadfc46a5940279e557de306f933e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:52.283514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:52.304805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1123/2253] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:54.623625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fef46-0d15-4d79-bac4-15670182487c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:54.625699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fef46-0d15-4d79-bac4-15670182487c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:54.626397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fef46-0d15-4d79-bac4-15670182487c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:54.680848 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-781fef46-0d15-4d79-bac4-15670182487c None None] MFA Rules not processed for user `9fd55f6b0b8f4db7baba304f6161966e`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:54.683379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-781fef46-0d15-4d79-bac4-15670182487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:54.884717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1131/2254] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:54.906139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:54.908416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:55.038990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913c741-b9d0-4c48-9b7a-f077f8817635 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:55.046108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:55.047491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:55.048256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:55.048985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:55.052737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:55.164258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:55.166779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4c9bb-f349-47ee-b3fc-66dfb318da9f service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:55.179619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1124/2255] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:56.995065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:56.996478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:56.996998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:57.035295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] MFA Rules not processed for user `18046792a7424f068c89a42d9d0ac332`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:57.038723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:57.074210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1132/2256] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:45:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:05.174352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:07.024970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=37 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:37.775458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9010c-b354-4538-af3e-8b6cc5a6ba10 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:37.776424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9010c-b354-4538-af3e-8b6cc5a6ba10 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:37.776424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9010c-b354-4538-af3e-8b6cc5a6ba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:37.814006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-72c9010c-b354-4538-af3e-8b6cc5a6ba10 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:37.815356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-72c9010c-b354-4538-af3e-8b6cc5a6ba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:37.826595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1125/2257] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:37.882802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:37.907023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3c55-f5d6-49ff-9f64-3cdc698dac0f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:37.915759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:37.916578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:37.917009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:37.917293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:37.931599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:37.934806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:37.953765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1133/2258] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:42.085850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:42.086693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:42.087195 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:42.129579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:42.131410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:42.148169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1126/2259] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:42.176273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:42.178689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:42.215863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0afae0-6978-45d3-9280-c8e13be566b4 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:42.226063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:42.227081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:42.227622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:42.228160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:42.255405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:42.258658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033b2cd-a5e1-443b-b112-0b44c75915cf service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:42.297885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1134/2260] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:47.197274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:47.215083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d61901-7a59-4b9e-be33-5ab8e60ccada None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:47.220344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:47.221027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:47.221274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:47.221550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:47.236150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:47.238162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:47.255466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1127/2261] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:47.678349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:47.679207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:47.679207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:47.723453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:47.726494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:47.739824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1135/2262] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:47.767391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:47.783617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faa923-1b71-48b0-a1c2-63579e33ce05 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:47.790142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:47.791053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:47.791645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:47.792014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:47.806818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:47.809819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f96e7-8e30-4406-9f17-8070b3ce16d9 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:47.830010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1128/2263] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:46:53.303443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:53.308295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:53.467052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa2a1c-f6e1-4b5b-9d4d-9fc7458af6c5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:53.474867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:53.475692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:53.476080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:53.476479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:53.479518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:53.498167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:53.499493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:53.519630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1136/2264] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:55.018954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26e4d-0ef9-400c-8478-1fe627cbf0f4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:55.019823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26e4d-0ef9-400c-8478-1fe627cbf0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:55.019987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26e4d-0ef9-400c-8478-1fe627cbf0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:55.045382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-38f26e4d-0ef9-400c-8478-1fe627cbf0f4 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:55.046994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-38f26e4d-0ef9-400c-8478-1fe627cbf0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:55.057880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1129/2265] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:55.083836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:55.101079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78a4b5-f7f7-4ba0-9137-306cdcf4c460 service placement] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:55.111566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:55.111566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:55.111566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:55.111566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:55.124184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:55.126974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ce974-380f-4cfe-b302-4655da219321 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:55.153011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1137/2266] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:55.418375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:55.418997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:55.419936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:55.481495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] MFA Rules not processed for user `0639368c7c8f4c6a835a776272840004`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:55.485377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:55.595914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1130/2267] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:02.443807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f6f2-f058-41d6-8036-f0e669bb9ce5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:02.444402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f6f2-f058-41d6-8036-f0e669bb9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:02.444402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f6f2-f058-41d6-8036-f0e669bb9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:02.477078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cbe3f6f2-f058-41d6-8036-f0e669bb9ce5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:02.479021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cbe3f6f2-f058-41d6-8036-f0e669bb9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:02.494232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1138/2268] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:02.517943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:02.532810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962456d-2e3a-4c68-828b-bfb2898cf653 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:02.541492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:02.542537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:02.542918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:02.543363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:02.555810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:02.557601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64591e-6675-4130-87ae-ae8819c4ecfb service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:02.580786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1131/2269] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:08.652950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:08.654312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:08.654532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:08.673589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=57 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:08.686578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] MFA Rules not processed for user `e954a59593cc4352a42d228d72cd47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:08.688699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:08.781161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1139/2270] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:09.281389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06d8f-38de-4e00-83fc-fe4744519127 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.282391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06d8f-38de-4e00-83fc-fe4744519127 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.282925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a06d8f-38de-4e00-83fc-fe4744519127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.293759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=53 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:09.332092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-39a06d8f-38de-4e00-83fc-fe4744519127 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:09.333537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-39a06d8f-38de-4e00-83fc-fe4744519127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.432656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1132/2271] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:47:09.507232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:09.508790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.629295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ab1c3-6b99-4a32-962d-18f04e4fa432 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:09.635323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:09.636217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.636500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.636837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.649666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:09.655873 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:09.665552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1140/2272] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:47:09.927462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c94bf-0923-4ea4-82ec-7178e5fedb5c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.928285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c94bf-0923-4ea4-82ec-7178e5fedb5c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.928988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c94bf-0923-4ea4-82ec-7178e5fedb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.982053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4b2c94bf-0923-4ea4-82ec-7178e5fedb5c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:09.984026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4b2c94bf-0923-4ea4-82ec-7178e5fedb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:10.007149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1133/2273] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:11.058373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:11.081503 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5852a1-90ff-48e0-a3db-75e78ba7f565 service swift] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:11.094275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:11.096218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:11.096701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:11.097758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:11.116957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:11.120153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797419c5-1c0a-47c3-a5bd-3ef39913ef1f service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:11.136351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1141/2274] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:19.969463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=27 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:21.129820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=62 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:37.927156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252794c6-8873-449d-b392-5177695c580b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:37.928597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252794c6-8873-449d-b392-5177695c580b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:37.928953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252794c6-8873-449d-b392-5177695c580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:37.951362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-252794c6-8873-449d-b392-5177695c580b None None] MFA Rules not processed for user `7bcadfc46a5940279e557de306f933e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:37.953048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-252794c6-8873-449d-b392-5177695c580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:37.961964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1134/2275] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:38.076287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.077340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.078436 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.083280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1142/2276] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:47:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:38.088680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270d1e-097f-4ddd-ae55-1edce7008bf6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.088994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270d1e-097f-4ddd-ae55-1edce7008bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.089310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270d1e-097f-4ddd-ae55-1edce7008bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.126495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-85270d1e-097f-4ddd-ae55-1edce7008bf6 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:38.128277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-85270d1e-097f-4ddd-ae55-1edce7008bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.142674 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1135/2277] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:38.156169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:38.158298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.258199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a2903-ac26-4c40-bd5b-08f381011c05 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:38.263233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:38.264039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.264365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.264673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.285486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:38.286945 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ae83-acf8-4eb1-b25f-05adf6efe952 service glance] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:38.302342 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1143/2278] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:38.428068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.428535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.429007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.431360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1136/2279] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:38.439057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c6f1-c197-4025-98cd-8385b3972ea4 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.439341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c6f1-c197-4025-98cd-8385b3972ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.439645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c6f1-c197-4025-98cd-8385b3972ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.468006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d735c6f1-c197-4025-98cd-8385b3972ea4 None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:38.469275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d735c6f1-c197-4025-98cd-8385b3972ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.482412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1144/2280] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:47:38.499938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:38.502483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.520007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a38db-4415-4a41-a10c-d8800eaade10 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:38.525122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:38.525814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.526148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.526622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.535581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:38.538174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fd209-5e19-455e-9cfc-b5113a4a1b1a service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:38.564000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1137/2281] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:38.717561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e4d2-fc8b-44e7-99b7-d840be86fa6f None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.717997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e4d2-fc8b-44e7-99b7-d840be86fa6f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.718491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5e4d2-fc8b-44e7-99b7-d840be86fa6f None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.722146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1145/2282] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:47:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:38.732957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d20d0-1391-44cc-8ead-7834c8f43deb None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.733446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d20d0-1391-44cc-8ead-7834c8f43deb None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.733916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d20d0-1391-44cc-8ead-7834c8f43deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.769941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-080d20d0-1391-44cc-8ead-7834c8f43deb None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:38.772351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-080d20d0-1391-44cc-8ead-7834c8f43deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.791050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1138/2283] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:38.816018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5e4d2-fc8b-44e7-99b7-d840be86fa6f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:38.836106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5e4d2-fc8b-44e7-99b7-d840be86fa6f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:38.842613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:38.844127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.844704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.845391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.864876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:38.867608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:38.890303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1146/2284] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:44.458506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872b00-6a48-47c1-9ed1-e4dda0ca8ad2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:44.459089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872b00-6a48-47c1-9ed1-e4dda0ca8ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:44.459495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75872b00-6a48-47c1-9ed1-e4dda0ca8ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:44.492826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-75872b00-6a48-47c1-9ed1-e4dda0ca8ad2 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:44.494272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-75872b00-6a48-47c1-9ed1-e4dda0ca8ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:44.513305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1139/2285] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:44.530118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:44.543457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aec617-7099-4fc6-8383-1a007c4bfe31 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:44.549679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:44.550295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:44.550571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:44.550846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:44.562725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:44.566136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:44.583869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1147/2286] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:47:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:47:54.486357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=18 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:54.577071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=41 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:13.155261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1556-9f6e-4821-8d7a-fa211d3bfb23 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:13.155850 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1556-9f6e-4821-8d7a-fa211d3bfb23 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:13.156184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1556-9f6e-4821-8d7a-fa211d3bfb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:13.189526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0c5e1556-9f6e-4821-8d7a-fa211d3bfb23 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:13.191559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0c5e1556-9f6e-4821-8d7a-fa211d3bfb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:13.205153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1140/2287] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:48:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:48:13.236247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:13.254842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf71d82-0040-4ab9-a3fc-a95403ce67fe service swift] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:13.264624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:13.265975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:13.266573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:13.267054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:13.284617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:13.286450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:13.297405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1148/2288] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:48:19.554130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b919-785b-43e3-85ce-6f71517c3904 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:19.554927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b919-785b-43e3-85ce-6f71517c3904 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:19.554927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87b919-785b-43e3-85ce-6f71517c3904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:19.580380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8f87b919-785b-43e3-85ce-6f71517c3904 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:19.581668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f87b919-785b-43e3-85ce-6f71517c3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:19.590983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1141/2289] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:19.628299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:19.641380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6560-435d-43b4-8c93-e2092ad8518b service swift] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:19.648109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:19.648800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:19.649119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:19.649431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:19.660026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:19.661968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:19.673259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1149/2290] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:23.937813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21fb72-9f9e-43ae-9d6e-1898bf741a0f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:23.938776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21fb72-9f9e-43ae-9d6e-1898bf741a0f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:23.938776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21fb72-9f9e-43ae-9d6e-1898bf741a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:23.966774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7f21fb72-9f9e-43ae-9d6e-1898bf741a0f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:23.968028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7f21fb72-9f9e-43ae-9d6e-1898bf741a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:23.979863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1142/2291] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:24.017520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:24.030807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bacf29-e985-4786-83e5-bce0d33b1e83 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:24.037194 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:24.037875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:24.038193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:24.038506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:24.051144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:24.054072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:24.072884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1150/2292] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:28.127463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80a2e-85db-4a70-a327-113d270b5c26 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:28.128010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80a2e-85db-4a70-a327-113d270b5c26 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:28.128010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd80a2e-85db-4a70-a327-113d270b5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:28.149226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4dd80a2e-85db-4a70-a327-113d270b5c26 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:28.150721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4dd80a2e-85db-4a70-a327-113d270b5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:28.159987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1143/2293] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:28.188005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:28.208647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d893-a860-4189-adb1-ef61208b951c service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:28.219047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:28.220191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:28.220682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:28.221200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:28.232653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:28.234486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:28.246468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1151/2294] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:32.418767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674394d-5911-42a1-b6bb-767bc83000ab None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:32.419357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674394d-5911-42a1-b6bb-767bc83000ab None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:32.419478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674394d-5911-42a1-b6bb-767bc83000ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:32.441804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0674394d-5911-42a1-b6bb-767bc83000ab None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:32.443036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0674394d-5911-42a1-b6bb-767bc83000ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:32.453447 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1144/2295] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:32.478057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:32.490258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e3c1-b65d-4670-b50b-394dee02b1cb service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:32.496676 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:32.497387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:32.497662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:32.497931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:32.507006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:32.508611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:32.519887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1152/2296] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:48:37.661367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac965-b818-41d9-8f10-8f303270413a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:37.662248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac965-b818-41d9-8f10-8f303270413a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:37.662474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaac965-b818-41d9-8f10-8f303270413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:37.675171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=16 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:37.691160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-afaac965-b818-41d9-8f10-8f303270413a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:48:37.692570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-afaac965-b818-41d9-8f10-8f303270413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:37.702126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1145/2297] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Aug 31 10:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:48:37.733443 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:37.739140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=31 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:37.749372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae2e2-376c-4f91-83f7-e72a7624e239 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:37.759522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:37.761587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:37.762088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:37.762583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:37.783393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:37.785680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:37.805485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1153/2298] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:47.683805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:47.795430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:52.958233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaac965-b818-41d9-8f10-8f303270413a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:52.970904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaac965-b818-41d9-8f10-8f303270413a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:52.974704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:52.975326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:52.975605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:52.975879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:52.979092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:52.995459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:52.996997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:53.013426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1146/2299] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:54.233333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:48:54.244542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328e83-8af7-4e02-820c-f86aeba53869 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:48:54.248491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:48:54.249158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:48:54.249434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:48:54.249702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:48:54.251452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:48:54.265666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:48:54.267091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:48:54.279307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1154/2300] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:48:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:03.004257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:04.273659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=6 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:06.918604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:06.931210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0d39-bb02-4aaa-bffc-3a472f18a35d service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:06.937872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:06.938682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:06.938992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:06.939365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:06.941591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:07.006921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:07.008662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:07.021976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1147/2301] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:12.491128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:12.492838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:12.506846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38600c73-d25f-4485-b0ba-bde0b14ca7bd service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:12.514766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:12.515892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:12.516328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:12.516818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:12.519736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:12.542693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:12.546145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:12.566985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1155/2302] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:12.569057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:12.587367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698712b-96b5-4ef1-ade1-b1c3b322954c service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:12.592583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:12.593469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:12.593781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:12.594045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] PATH_INFO: `/v3/users/7bcadfc46a5940279e557de306f933e3` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:12.595351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcadfc46a5940279e557de306f933e3)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:12.597784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:12.651185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcadfc46a5940279e557de306f933e3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:12.659563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcadfc46a5940279e557de306f933e3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:12.660540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcadfc46a5940279e557de306f933e3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:12.661505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcadfc46a5940279e557de306f933e3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:12.682591 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcadfc46a5940279e557de306f933e3'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:12.700248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1148/2303] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:49:12 2022] DELETE /identity/v3/users/7bcadfc46a5940279e557de306f933e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:49:12.898132 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:12.923637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d37f74-367a-4bc6-b717-6274e2d5d8b4 service placement] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:12.994281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:12.994915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:12.995193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:12.995462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] PATH_INFO: `/v3/projects/1fb40eecae544291aef664ce1c50db28` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:12.996661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb40eecae544291aef664ce1c50db28)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:12.998712 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:13.059536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb40eecae544291aef664ce1c50db28', 'request_id': 'req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:13.066226 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb40eecae544291aef664ce1c50db28', 'request_id': 'req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:13.076585 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb40eecae544291aef664ce1c50db28', 'request_id': 'req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:13.087643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] The token cache is being invalidate because project 1fb40eecae544291aef664ce1c50db28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:49:13.087939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:13.088598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:13.090136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1156/2304] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:49:12 2022] DELETE /identity/v3/projects/1fb40eecae544291aef664ce1c50db28 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:49:15.687930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:15.693503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:15.794404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1571-d9d2-49ba-8f39-c8271287c2cd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:15.800479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:15.891359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:15.891973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:15.892252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:15.892521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:15.894414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:15.968352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:15.969906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:15.979683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1149/2305] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:22.468815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:22.470372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:22.486526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4dd1-ab07-46dd-bce3-8083b3d3ba97 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:22.492828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:22.494063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:22.494351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:22.494625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:22.496395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:22.561657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:22.563348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:22.584053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1157/2306] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:25.975023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=52 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:28.192349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:28.194316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:28.283767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbc085-37ae-4b7a-a3fc-340a49c27936 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:28.289999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:28.290957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:28.291289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:28.291757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:28.294874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:28.307131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:28.308572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171337bf-cb50-4fb1-9474-ea4de47c6d93 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:28.316821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1150/2307] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:30.324193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:30.329594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:30.384894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db72a2-3731-4cdc-b5a4-21001fadb765 service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:30.399776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:30.401651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:30.402415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:30.403316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:30.408498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:30.455809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:30.458949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:30.486974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1158/2308] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:32.958710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007341b5-a168-4426-80e2-44289caac659 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:32.959205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007341b5-a168-4426-80e2-44289caac659 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:32.959369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007341b5-a168-4426-80e2-44289caac659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:32.985334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-007341b5-a168-4426-80e2-44289caac659 None None] MFA Rules not processed for user `0639368c7c8f4c6a835a776272840004`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:32.986555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-007341b5-a168-4426-80e2-44289caac659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:32.994908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1151/2309] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:33.439965 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:33.447592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:33.458757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95177f-1299-4b3c-9f6c-b47382196dff service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:33.476967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:33.478322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:33.479027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:33.479467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:33.483379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:33.497253 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:33.499749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf3892-c86b-4c14-89b0-70db1653afd4 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:33.511490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1159/2310] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:34.026954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007341b5-a168-4426-80e2-44289caac659 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:34.029108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-007341b5-a168-4426-80e2-44289caac659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:34.136953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007341b5-a168-4426-80e2-44289caac659 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:34.142711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:34.143246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:34.143523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:34.143810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:34.145914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:34.158754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:34.160352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:34.173568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1152/2311] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:34.808418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:34.808893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:34.809126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:34.832926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] MFA Rules not processed for user `476c96600c524cc293bc0e0a65ee8cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:34.834853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:34.850977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1160/2312] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:35.322353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:35.336163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1909936-0eca-4523-8c78-a7e7e4fde721 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:35.340095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:35.340702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:35.341010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:35.341279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:35.343068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:35.357518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:35.361990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfff7cff-f5b2-4f5e-a1e5-853ce96eee96 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:35.375592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1153/2313] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:44.826359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:45.371391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=67 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:49.665140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:49.688656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714743b9-248d-415f-a8e2-4c7445b5d2f8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:49.703835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:49.707427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:49.708106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:49.708583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:49.714038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:49.732175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:49.734575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:49.755811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1161/2314] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:55.202248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d6a0-a2a0-4616-b5d2-330a0e0b681d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:55.203198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d6a0-a2a0-4616-b5d2-330a0e0b681d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:55.203198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485d6a0-a2a0-4616-b5d2-330a0e0b681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:55.238815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4485d6a0-a2a0-4616-b5d2-330a0e0b681d None None] MFA Rules not processed for user `e954a59593cc4352a42d228d72cd47fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:55.240972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4485d6a0-a2a0-4616-b5d2-330a0e0b681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:55.352357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1154/2315] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:49:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:56.411130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:56.423281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff1ed-a285-4642-a09b-5375b09edd2b service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:56.430345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:56.430972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:56.431251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:56.431523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:56.433594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:56.449010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:56.450626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:56.465995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1162/2316] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:05.343284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=25 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:06.457484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=12 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:19.596535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:19.597474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:19.597641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:19.627085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] MFA Rules not processed for user `9cd5a46657f641e7b0db8684963c0246`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:19.629017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:19.698309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1155/2317] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:29.689975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=25 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:10.063217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:10.064607 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:10.156553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951eccfa-2c44-464b-b27e-3e40d1cb43bd service nova] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:10.161671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:10.162384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:10.162658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:10.162925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:10.164711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:10.176093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:10.178287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eadb0a-aa35-41a2-a8cb-093dcfa4e882 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:10.187711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1163/2318] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:20.183543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=26 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:32.885955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:32.887742 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:32.901472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd078a65-a7c1-4f37-b93f-b87df58fd3fa None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:32.905632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:32.906352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:32.906725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:32.907229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:32.909819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:33.031913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:33.033429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:33.052037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1156/2319] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:37.496785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:37.498042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:37.499540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:37.527370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] MFA Rules not processed for user `0639368c7c8f4c6a835a776272840004`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:37.528600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:37.539238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1164/2320] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:38.013518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.026858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3810c-c680-48a5-9af3-d87d20ec8fa6 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:38.032738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:38.033724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.034204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.034662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.036918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:38.055366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:38.057634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:38.072357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1157/2321] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:38.133887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.135769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:38.160207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed156b-b004-46c1-81f9-7f703836e890 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:38.168251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:38.168949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.169381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.169931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] PATH_INFO: `/v3/users/e954a59593cc4352a42d228d72cd47fd` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.171001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e954a59593cc4352a42d228d72cd47fd)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:38.174591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:38.256857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e954a59593cc4352a42d228d72cd47fd'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.257606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e954a59593cc4352a42d228d72cd47fd'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.267948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e954a59593cc4352a42d228d72cd47fd'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.283039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e954a59593cc4352a42d228d72cd47fd'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.298791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e3611ba5-b0da-43b7-9071-7d1727821258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e954a59593cc4352a42d228d72cd47fd'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.307146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1165/2322] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:51:38 2022] DELETE /identity/v3/users/e954a59593cc4352a42d228d72cd47fd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:51:38.528077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.540961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb36928-7823-48bc-a272-6694220f5705 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:38.608772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:38.609441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.609718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.609990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] PATH_INFO: `/v3/projects/8f6b9e5d3c9a42d0b07491fed3bf339b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.611494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6b9e5d3c9a42d0b07491fed3bf339b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:38.613445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:38.670239 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6b9e5d3c9a42d0b07491fed3bf339b', 'request_id': 'req-51281336-b797-4806-89a2-be35d6c77fd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.676851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6b9e5d3c9a42d0b07491fed3bf339b', 'request_id': 'req-51281336-b797-4806-89a2-be35d6c77fd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.688919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6b9e5d3c9a42d0b07491fed3bf339b', 'request_id': 'req-51281336-b797-4806-89a2-be35d6c77fd2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.702562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] The token cache is being invalidate because project 8f6b9e5d3c9a42d0b07491fed3bf339b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:51:38.702882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.703936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-51281336-b797-4806-89a2-be35d6c77fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:51:38.705854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1158/2323] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:51:38 2022] DELETE /identity/v3/projects/8f6b9e5d3c9a42d0b07491fed3bf339b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:51:38.711609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.712204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.712204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.738055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:38.739389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:38.827866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1166/2324] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:51:38.836645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.836961 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.837240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.859089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:38.860327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:38.869520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1159/2325] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:38.874755 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.890418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93a993-37d4-4c97-8a3f-a966fffe88c8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:38.895803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:38.896727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.897283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.900809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.900809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:51:38.900809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:38.900809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:38.916876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1167/2326] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:51:38.921245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.929363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:38.935644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314acb74-d196-458c-8763-5bd444cf7bd0 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:38.945188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:38.946085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:38.946396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:38.946693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:38.947756 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:38.950050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:38.982184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1160/2327] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:51:38 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:51:38.986078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:38.997981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3c75e-10e3-481c-bd78-e4bf0a2cda1c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.055005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:39.071583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.072367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.072638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.072960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.074405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.076809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.105874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1168/2328] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:51:38 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:51:39.107288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.120325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab79c5e-e4fa-4a46-93c8-a693e0233519 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.124963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.125564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.125839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.126132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.126777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.128470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.142058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1161/2329] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:51:39.146247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.156978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e76d1-0a1a-4610-96d9-5a62b104b2e6 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.165176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.165803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.166080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.166350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.166996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.169879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadb7c7-cb9f-4e30-8366-c0e94ca10d47 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.184141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1169/2330] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:51:39.188347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.203249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980210f1-0f15-4637-9d5f-b10c28dd7583 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.211517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.212636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.213147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.213632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] PATH_INFO: `/v3/projects/5252fd5c9a084320a9a4f73afcc54863/users/a20db996307a4b6988a315c106e5b9be/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.238910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5252fd5c9a084320a9a4f73afcc54863, user_id=a20db996307a4b6988a315c106e5b9be, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.242972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.260845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1162/2331] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:51:39 2022] PUT /identity/v3/projects/5252fd5c9a084320a9a4f73afcc54863/users/a20db996307a4b6988a315c106e5b9be/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:51:39.272904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.273255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.273680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.316233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] MFA Rules not processed for user `a20db996307a4b6988a315c106e5b9be`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:39.317608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:39.410381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1170/2332] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:39.416037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.539633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e8ba6-678e-4a87-af3e-c25a5a884704 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.544644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.545291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.545570 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.545841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.547738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.548594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.613687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1163/2333] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:51:39 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:51:39.619600 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.666352 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad9607-ac79-4151-aa14-0d51b49cb70b None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.747572 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.748270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.748502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.748800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.749457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.751466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.781526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1171/2334] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:51:39 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:51:39.785706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.804670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e8ac4-d73a-454d-8532-33ed8efae2ce admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.811235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.813113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.813113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.813113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.813472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.817483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.831410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1164/2335] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:51:39.836518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.847856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92684c-6d85-4257-b6ba-ef4cc3872991 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.856288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.857196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.857547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.857895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] PATH_INFO: `/v3/projects/a4b8577d42c84d3fa782da587bbd7763/users/7d55b350b66743f98d280d20b06fed20/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.876978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b8577d42c84d3fa782da587bbd7763, user_id=7d55b350b66743f98d280d20b06fed20, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.879779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:39.890142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:39.896145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1172/2336] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:51:39 2022] PUT /identity/v3/projects/a4b8577d42c84d3fa782da587bbd7763/users/7d55b350b66743f98d280d20b06fed20/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:51:39.901129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:39.912883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae4cd-87c9-4fb3-9075-063846d4f5fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:39.958172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:39.996408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:39.997053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:39.997334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:39.997608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:39.998254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:39.999866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf4377-ee25-47b2-8005-0e58fd88fc54 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:40.011707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1165/2337] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:51:40.016157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:40.027860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25dca6-e137-4ada-8920-b5459ea9b192 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:40.032538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:40.033232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:40.033528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:40.033776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] PATH_INFO: `/v3/projects/a4b8577d42c84d3fa782da587bbd7763/users/7d55b350b66743f98d280d20b06fed20/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:40.035714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b8577d42c84d3fa782da587bbd7763, user_id=7d55b350b66743f98d280d20b06fed20, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:40.038684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:40.049702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1173/2338] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:51:40 2022] PUT /identity/v3/projects/a4b8577d42c84d3fa782da587bbd7763/users/7d55b350b66743f98d280d20b06fed20/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:51:40.060681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:40.061132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:40.061503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:40.102215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] MFA Rules not processed for user `7d55b350b66743f98d280d20b06fed20`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:40.103789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:40.205467 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1166/2339] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:40.218183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:40.220418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:40.316516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9798-e068-4832-9b98-e0820781734b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:40.320584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:40.321228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:40.321511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:40.321854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:40.333484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:40.336601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca1f2c-d623-405d-b513-f5252239a0cd service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:40.354923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1174/2340] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:40.447804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:40.457714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c51dfe-f287-47e8-aa9e-3efb0e8e60d4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:40.462358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:40.462979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:40.463288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:40.463517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:40.545770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:40.547417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:40.558053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1167/2341] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:51:50.345114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:50.553054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=78 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:54.609872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:54.610414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:54.610793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:54.664269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:54.667119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:54.751580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1175/2342] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:54.815253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:54.818019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:54.918484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232ba7-550c-4499-a7cf-bd01d05782b2 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:54.923851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:54.924499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:54.924795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:54.925080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:54.933848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:54.935463 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:54.944678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1168/2343] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:51:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:52:02.523188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:02.525804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:02.684938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2911cf7-7b68-47d2-a70a-5197f1ef5b37 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:02.692208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:02.693618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:02.693918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:02.694338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:02.698179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:02.803407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:02.804923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5127f-d47e-439b-b089-7f88122e906b service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:02.815377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1176/2344] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:04.940740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=32 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:09.365687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:09.367184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:09.499655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5d3ac-5b67-4ffa-98bc-99be50c87d86 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:09.506085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:09.506669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:09.506946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:09.507218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:09.509061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:09.524957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:09.526953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c2886-3139-4e37-90f0-eb1877eccc29 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:09.538149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1169/2345] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:11.073107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.073107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.073107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.073107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1177/2346] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:11.082000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c56e-5690-4181-a34c-0526176bcaa0 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.082758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c56e-5690-4181-a34c-0526176bcaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.082758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0c56e-5690-4181-a34c-0526176bcaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.164213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-baa0c56e-5690-4181-a34c-0526176bcaa0 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:11.165584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-baa0c56e-5690-4181-a34c-0526176bcaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:11.269815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1170/2347] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:11.282456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:11.284244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:11.315301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:11.353268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f248298-918d-4023-89ee-34e3faafd189 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:11.357289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:11.357910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.358426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.358721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.370876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:11.372291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2431863-afd3-4acc-b958-5c230c1cd3f7 service glance] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:11.388469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1178/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:11.460000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63d4a-fbac-48f2-8eb2-2407cea7397b None None] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.460292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63d4a-fbac-48f2-8eb2-2407cea7397b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.460630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab63d4a-fbac-48f2-8eb2-2407cea7397b None None] PATH_INFO: `/` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.462844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1171/2349] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:11.469744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fc8d-ddb5-429e-8689-cb6f4bd92dde None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.470144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fc8d-ddb5-429e-8689-cb6f4bd92dde None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.470528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71fc8d-ddb5-429e-8689-cb6f4bd92dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.492225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bc71fc8d-ddb5-429e-8689-cb6f4bd92dde None None] MFA Rules not processed for user `f0ea57d0513345ab8a0910ac780d7b32`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:11.493475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bc71fc8d-ddb5-429e-8689-cb6f4bd92dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:11.500675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1179/2350] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:11.513503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab63d4a-fbac-48f2-8eb2-2407cea7397b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:11.526233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab63d4a-fbac-48f2-8eb2-2407cea7397b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:11.530069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:11.530751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.531023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.531288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.539271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:11.540714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39b8fd-2e05-4174-9ea1-7746df13fe4f service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:11.548995 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1172/2351] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:11.651091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f062d6-4fcf-4211-9091-61337d686ac5 None None] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.651730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f062d6-4fcf-4211-9091-61337d686ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.652252 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f062d6-4fcf-4211-9091-61337d686ac5 None None] PATH_INFO: `/` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.654055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1180/2352] 10.222.0.70 () {54 vars in 921 bytes} [Wed Aug 31 10:52:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:11.661765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.662055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.662334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.684273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] MFA Rules not processed for user `211155364dfd4a60bc13efa3c7d7fa98`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:11.685546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:11.695561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1173/2353] 10.222.0.70 () {58 vars in 1018 bytes} [Wed Aug 31 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:11.709558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f062d6-4fcf-4211-9091-61337d686ac5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:11.722551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f062d6-4fcf-4211-9091-61337d686ac5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:11.726239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:11.727381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.727801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.728075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.738903 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:11.740341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:11.754271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1181/2354] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:52:11.956650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:11.967813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc45c0-0939-418e-8839-68c8cd3da239 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:11.971998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:11.972704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:11.972951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:11.973226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:11.975024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:11.986722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:12.050670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:12.052049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75040-7cfe-4488-a83d-17103fb1b0da service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:12.066479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1174/2355] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:52:12.997855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:13.010841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b4135-51de-47f6-a207-15131477b52e service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:13.015501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:13.016250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:13.016624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:13.017064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] PATH_INFO: `/v3/users/a20db996307a4b6988a315c106e5b9be` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:13.018401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20db996307a4b6988a315c106e5b9be)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:13.021128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:13.096906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20db996307a4b6988a315c106e5b9be'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.097826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20db996307a4b6988a315c106e5b9be'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.107799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20db996307a4b6988a315c106e5b9be'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.124413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20db996307a4b6988a315c106e5b9be'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.136050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20db996307a4b6988a315c106e5b9be'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.145790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1182/2356] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:12 2022] DELETE /identity/v3/users/a20db996307a4b6988a315c106e5b9be => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:13.150602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:13.151261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:13.151261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:13.183271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:13.184482 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:13.247848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1175/2357] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:13.257674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:13.259316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:13.320801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb11-c1c0-4942-b63e-a92c11baae2b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:13.324501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:13.325146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:13.325425 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:13.325700 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:13.335417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:13.337629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:13.350053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1183/2358] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:13.743879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:13.751298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:13.780537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67292df7-283d-4332-8d3f-1e50345d0898 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:13.786354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:13.787336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:13.787821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:13.788099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] PATH_INFO: `/v3/projects/5252fd5c9a084320a9a4f73afcc54863` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:13.790014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5252fd5c9a084320a9a4f73afcc54863)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:13.792232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:13.882219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5252fd5c9a084320a9a4f73afcc54863', 'request_id': 'req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.889715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5252fd5c9a084320a9a4f73afcc54863', 'request_id': 'req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.901780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5252fd5c9a084320a9a4f73afcc54863', 'request_id': 'req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.914644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] The token cache is being invalidate because project 5252fd5c9a084320a9a4f73afcc54863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:13.914938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.915693 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:13.917234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1176/2359] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:13 2022] DELETE /identity/v3/projects/5252fd5c9a084320a9a4f73afcc54863 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:13.921239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:13.932114 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540d0e-e5e5-481d-8a73-7b098868b86e service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:13.952488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:14.001120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:14.001946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:14.002229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:14.002506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] PATH_INFO: `/v3/users/7d55b350b66743f98d280d20b06fed20` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:14.003901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d55b350b66743f98d280d20b06fed20)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:14.006750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:14.078754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d55b350b66743f98d280d20b06fed20'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:14.088622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d55b350b66743f98d280d20b06fed20'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:14.105610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d55b350b66743f98d280d20b06fed20'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:14.123086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d55b350b66743f98d280d20b06fed20'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:14.130711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0e490f4a-ec95-4730-b44e-005f7abbf1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d55b350b66743f98d280d20b06fed20'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:14.140725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1184/2360] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:13 2022] DELETE /identity/v3/users/7d55b350b66743f98d280d20b06fed20 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:15.279898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:15.282798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:15.310262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ffa6f-a3f3-4635-a0a9-af310e1b8bdf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:15.360569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:15.422367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:15.423954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.424548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.424870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] PATH_INFO: `/v3/projects/a4b8577d42c84d3fa782da587bbd7763` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.426804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b8577d42c84d3fa782da587bbd7763)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:15.433305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:15.517836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b8577d42c84d3fa782da587bbd7763', 'request_id': 'req-fafd11e9-e2a3-4666-a198-27ea2206e776'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:15.527184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b8577d42c84d3fa782da587bbd7763', 'request_id': 'req-fafd11e9-e2a3-4666-a198-27ea2206e776'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:15.541937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b8577d42c84d3fa782da587bbd7763', 'request_id': 'req-fafd11e9-e2a3-4666-a198-27ea2206e776'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:15.556656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] The token cache is being invalidate because project a4b8577d42c84d3fa782da587bbd7763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:15.557181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:15.557934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-fafd11e9-e2a3-4666-a198-27ea2206e776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:15.559768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1177/2361] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:15 2022] DELETE /identity/v3/projects/a4b8577d42c84d3fa782da587bbd7763 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:15.564789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9eda-9b3e-4238-acbe-ab601878d071 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.565306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9eda-9b3e-4238-acbe-ab601878d071 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.565552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9eda-9b3e-4238-acbe-ab601878d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.706500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f2ef9eda-9b3e-4238-acbe-ab601878d071 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:15.713177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f2ef9eda-9b3e-4238-acbe-ab601878d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:15.738966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.739343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.739740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.771352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:15.772903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:15.829566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1185/2362] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:15.838517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.838810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.839083 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.862400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:15.862879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1178/2363] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:15.864310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:15.874306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1186/2364] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:15.876976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:15.878509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:15.878887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:15.894912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fb756-75cc-4c85-820c-fc18fcca5a4f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:15.901046 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:15.901938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.902210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.902635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.903455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:15.903753 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:15.905448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:15.920086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1187/2365] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:15.924727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:15.935782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7646f-1eb0-4f21-8680-8512e15b6b61 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:15.941029 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:15.941640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.941916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.942186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:15.942834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:15.944745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:15.950027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:15.970707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:15.986012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf107-97ce-454b-8889-4825d9724338 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:15.995304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:15.996094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:15.996594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:15.997031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.001645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1188/2366] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:15 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:16.007087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:16.009272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:16.011670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:16.023660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1179/2367] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:52:16.104209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2390b-81b9-4670-991f-974e8eefe85a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:16.115405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:16.116110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:16.116462 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:16.118366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.119382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:16.121853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:16.202936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1189/2368] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:16 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:16.207093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:16.223257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdb247-2286-4372-b814-940cd794eb9e service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:16.242667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:16.243388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:16.243767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:16.244280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.245081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:16.246817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:16.275550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1180/2369] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:16.279820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:16.305540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66aaa84-239a-4e49-9d51-2d9affe794fb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:16.321027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:16.323692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:16.324070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:16.324864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.327713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:16.337754 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcc8ae-0f5e-4e2e-a95e-d22cd0f948f2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:16.370180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1190/2370] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:16.370488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:16.405323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d43b-b335-454a-b2a7-0907b3035f5c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:16.416045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:16.418279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:16.419193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:16.419744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] PATH_INFO: `/v3/projects/05722e314dc049e381b58eebc7cae746/users/1aa7dd4e75584dbd91464d4c8dbabe12/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.492901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05722e314dc049e381b58eebc7cae746, user_id=1aa7dd4e75584dbd91464d4c8dbabe12, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:16.495957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:16.540861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1181/2371] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:16 2022] PUT /identity/v3/projects/05722e314dc049e381b58eebc7cae746/users/1aa7dd4e75584dbd91464d4c8dbabe12/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:16.545218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:16.545591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:16.545920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:16.625308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] MFA Rules not processed for user `1aa7dd4e75584dbd91464d4c8dbabe12`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:16.629368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:16.877455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1191/2372] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:16.881352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.051491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100cb6d-0a76-4e01-a62f-81740cec7401 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.063541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.064715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.065253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.065795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.066830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.074809 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.161160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1182/2373] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:16 2022] POST /identity/v3/projects => generated 369 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:17.162566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.186562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb984e58-1709-4013-998f-d0f41d934122 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.365601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:17.383879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.385310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.385618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.386390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.387125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.390774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.424492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1192/2374] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:17 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:17.426542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.442163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098cab1-e0c2-40b8-8cd3-f1b8bee2772e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.462858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.466182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.466539 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.466908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.467796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.474100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.518292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1183/2375] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:17.524632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.541328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba651b1-e3e9-44bb-9b8e-be152a95ec4d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.549159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.549842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.550201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.550410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] PATH_INFO: `/v3/projects/7818457851ac47dd890ebcea4312f8fc/users/fba1a2897a3b49a28d3b400b8634ca25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.585007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7818457851ac47dd890ebcea4312f8fc, user_id=fba1a2897a3b49a28d3b400b8634ca25, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.593525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.625080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1193/2376] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:17 2022] PUT /identity/v3/projects/7818457851ac47dd890ebcea4312f8fc/users/fba1a2897a3b49a28d3b400b8634ca25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:17.625185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.633196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10bc4-0d8f-48b0-a2c1-ee04f9e2c176 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.737959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.738616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.741310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.742085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.743378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.765631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf693f-166c-4fb2-b9e9-eb8b49d62280 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.797041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1184/2377] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:17.798387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:17.819669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a09e4-1e60-4190-b767-d314c87b21f3 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:17.832799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:17.833868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.834385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.834845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] PATH_INFO: `/v3/projects/7818457851ac47dd890ebcea4312f8fc/users/fba1a2897a3b49a28d3b400b8634ca25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.837970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7818457851ac47dd890ebcea4312f8fc, user_id=fba1a2897a3b49a28d3b400b8634ca25, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:17.844163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:17.877005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1194/2378] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:17 2022] PUT /identity/v3/projects/7818457851ac47dd890ebcea4312f8fc/users/fba1a2897a3b49a28d3b400b8634ca25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:17.888887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:17.889337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:17.889653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:17.946663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] MFA Rules not processed for user `fba1a2897a3b49a28d3b400b8634ca25`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:17.948354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:17.964063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:18.073902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1185/2379] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:18.094280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:18.103925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:18.313288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995904-8216-43ae-ae77-784ebd748fde admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:18.317796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:18.319146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:18.319771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:18.321032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:18.332643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:18.334830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:18.359506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1195/2380] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:18.437549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:18.439421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:18.466044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cd6bc-33a9-42e5-9480-7cdf386f74ea None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:18.470714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:18.471808 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:18.472297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:18.472807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:18.624629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:18.626148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:18.647908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1186/2381] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:22.911583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:22.914427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:23.103142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580f9c-cc37-4f0d-80b0-e10a0258ff0a service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:23.124080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:23.128974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:23.129529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:23.129850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] PATH_INFO: `/v3/users/18046792a7424f068c89a42d9d0ac332` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:23.145685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] RBAC: Authorizing `identity:delete_user(user_id=18046792a7424f068c89a42d9d0ac332)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:23.157170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:23.270084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:23.315920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18046792a7424f068c89a42d9d0ac332'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.318291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18046792a7424f068c89a42d9d0ac332'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.350048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18046792a7424f068c89a42d9d0ac332'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.357481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:23.383666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92876d7d-490a-4ead-a7d3-ab59f609af34 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:23.393835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18046792a7424f068c89a42d9d0ac332'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.394154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:23.395025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:23.395295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:23.395664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] PATH_INFO: `/v3/users/1aa7dd4e75584dbd91464d4c8dbabe12` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:23.401785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa7dd4e75584dbd91464d4c8dbabe12)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:23.412291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:23.419748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2a311073-2ed0-4dff-bfb2-3828c4bfaead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18046792a7424f068c89a42d9d0ac332'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.436146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1196/2382] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:22 2022] DELETE /identity/v3/users/18046792a7424f068c89a42d9d0ac332 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:23.551952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa7dd4e75584dbd91464d4c8dbabe12'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.577495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa7dd4e75584dbd91464d4c8dbabe12'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.584023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa7dd4e75584dbd91464d4c8dbabe12'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.584834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa7dd4e75584dbd91464d4c8dbabe12'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.629478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa7dd4e75584dbd91464d4c8dbabe12'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:23.668589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1187/2383] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:23 2022] DELETE /identity/v3/users/1aa7dd4e75584dbd91464d4c8dbabe12 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:23.675889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:23.677013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:23.677812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:23.727283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:23.728743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:23.732213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:23.734789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:23.811024 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:23.853661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1197/2384] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:23.869162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:23.871560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:23.940798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6745320-8352-4f80-b735-0ef98dd8e0b3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:23.948041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:23.949224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:23.949764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:23.950177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] PATH_INFO: `/v3/projects/532877f7e1904db991154a0fce5e86f4` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:23.952324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd2779-4aca-4967-ad3a-4c780c7ea373 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:23.953395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532877f7e1904db991154a0fce5e86f4)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:23.956883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:23.957146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:23.957522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:23.957804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:23.958073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:23.971475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:23.973423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:23.990680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1198/2385] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:24.064165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532877f7e1904db991154a0fce5e86f4', 'request_id': 'req-4ed54352-2c69-4d00-9b9b-88467071cbb2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.084476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532877f7e1904db991154a0fce5e86f4', 'request_id': 'req-4ed54352-2c69-4d00-9b9b-88467071cbb2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.107538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532877f7e1904db991154a0fce5e86f4', 'request_id': 'req-4ed54352-2c69-4d00-9b9b-88467071cbb2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.156306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] The token cache is being invalidate because project 532877f7e1904db991154a0fce5e86f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:24.156634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.158888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.167486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1188/2386] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:23 2022] DELETE /identity/v3/projects/532877f7e1904db991154a0fce5e86f4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:24.169571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:24.193191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c785b-9653-4c0d-85d8-59153e0a4346 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:24.327727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:24.353307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:24.354199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:24.363065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:24.363496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] PATH_INFO: `/v3/users/9fd55f6b0b8f4db7baba304f6161966e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:24.377036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd55f6b0b8f4db7baba304f6161966e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:24.383843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:24.530669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd55f6b0b8f4db7baba304f6161966e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.532062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd55f6b0b8f4db7baba304f6161966e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.548526 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd55f6b0b8f4db7baba304f6161966e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.580158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd55f6b0b8f4db7baba304f6161966e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.600371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd55f6b0b8f4db7baba304f6161966e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.610988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1199/2387] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:24 2022] DELETE /identity/v3/users/9fd55f6b0b8f4db7baba304f6161966e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:24.649184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:24.650632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:24.683244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed54352-2c69-4d00-9b9b-88467071cbb2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:24.854852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:24.855954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:24.856832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:24.857303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] PATH_INFO: `/v3/projects/05722e314dc049e381b58eebc7cae746` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:24.859865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05722e314dc049e381b58eebc7cae746)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:24.863163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:24.954878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05722e314dc049e381b58eebc7cae746', 'request_id': 'req-b960931e-3d89-447f-9d38-cf59187c3c7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.958713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:24.974703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05722e314dc049e381b58eebc7cae746', 'request_id': 'req-b960931e-3d89-447f-9d38-cf59187c3c7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:24.990798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05722e314dc049e381b58eebc7cae746', 'request_id': 'req-b960931e-3d89-447f-9d38-cf59187c3c7a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.012362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:25.014665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:25.022287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] The token cache is being invalidate because project 05722e314dc049e381b58eebc7cae746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:25.023399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.024796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.027254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1189/2388] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:24 2022] DELETE /identity/v3/projects/05722e314dc049e381b58eebc7cae746 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:25.033252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:25.037150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:25.041097 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54b05b-8893-4456-864c-902833edd131 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:25.130131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:25.130770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:25.131050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:25.131324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] PATH_INFO: `/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:25.132596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b062795b9b84c49a8b0b900a98b0b2b)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:25.134674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:25.137354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960931e-3d89-447f-9d38-cf59187c3c7a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:25.142400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:25.143139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:25.143490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:25.143823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] PATH_INFO: `/v3/users/fba1a2897a3b49a28d3b400b8634ca25` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:25.145377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba1a2897a3b49a28d3b400b8634ca25)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:25.147331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:25.193146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b062795b9b84c49a8b0b900a98b0b2b', 'request_id': 'req-26aab60f-c174-4dd7-9d98-b76cf3352a87'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.199962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b062795b9b84c49a8b0b900a98b0b2b', 'request_id': 'req-26aab60f-c174-4dd7-9d98-b76cf3352a87'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.205781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba1a2897a3b49a28d3b400b8634ca25'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.208832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b062795b9b84c49a8b0b900a98b0b2b', 'request_id': 'req-26aab60f-c174-4dd7-9d98-b76cf3352a87'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.213951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba1a2897a3b49a28d3b400b8634ca25'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.214998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba1a2897a3b49a28d3b400b8634ca25'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.216262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba1a2897a3b49a28d3b400b8634ca25'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.218915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:25.224297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] The token cache is being invalidate because project 9b062795b9b84c49a8b0b900a98b0b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:25.224606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.225331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.228794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1200/2389] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:25 2022] DELETE /identity/v3/projects/9b062795b9b84c49a8b0b900a98b0b2b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:25.232391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e350bf2d-4904-4a98-9cb1-a991a1428f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba1a2897a3b49a28d3b400b8634ca25'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.249282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1190/2390] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:25 2022] DELETE /identity/v3/users/fba1a2897a3b49a28d3b400b8634ca25 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:25.607358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:25.609935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:25.701458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aab60f-c174-4dd7-9d98-b76cf3352a87 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:25.775875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:25.776518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:25.776874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:25.777149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] PATH_INFO: `/v3/projects/7818457851ac47dd890ebcea4312f8fc` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:25.778306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7818457851ac47dd890ebcea4312f8fc)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:25.780247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:25.849667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7818457851ac47dd890ebcea4312f8fc', 'request_id': 'req-005a325b-bca0-43cc-b0a5-4bcc723e38fc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.856822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7818457851ac47dd890ebcea4312f8fc', 'request_id': 'req-005a325b-bca0-43cc-b0a5-4bcc723e38fc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.864674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7818457851ac47dd890ebcea4312f8fc', 'request_id': 'req-005a325b-bca0-43cc-b0a5-4bcc723e38fc'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.875988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] The token cache is being invalidate because project 7818457851ac47dd890ebcea4312f8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:25.876270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.876949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-005a325b-bca0-43cc-b0a5-4bcc723e38fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:25.878452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1201/2391] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:25 2022] DELETE /identity/v3/projects/7818457851ac47dd890ebcea4312f8fc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:25.884339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:25.884952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:25.885094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:25.912044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:25.913843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:25.981854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:25.993846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1191/2392] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:26.002258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.002603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.002929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.026275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:26.028021 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:26.039984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1202/2393] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:26.044560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.056058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c46b7-dca0-43e3-a717-1f2fbb55ceb6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.061088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.061751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.062094 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.062382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.062994 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:26.063287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.065134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.080492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1192/2394] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:26.085793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.097325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09542b7d-98df-4fa7-ad7e-61d6af69c858 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.103675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.104321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.104583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.104902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.105543 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.107496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.145096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1203/2395] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:26.150152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.162711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b509a9-91a8-4437-8402-31c5935fcf0e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.233607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.234221 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.234584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.234859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.235522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.237544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.269014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1193/2396] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:26.270657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.284060 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03187513-db53-4d3b-832a-2503ae6cc18d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.290458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.291069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.291349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.291618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.292332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.294203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.296709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:26.309066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1204/2397] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:26.313504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.324843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2306300-10f5-41cc-86e8-8c85eccaedb1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.330405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.331050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.331327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.331618 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.332261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.334138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229db48-3bf3-49b2-8d83-d3ec3163a0fc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.347713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1194/2398] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:26.352709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.364103 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d372a-e3ab-43df-93b4-ae7a70e73ddb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.370193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.371036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.371329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.371654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] PATH_INFO: `/v3/projects/9c04a7dc5d0e4325953028476402a275/users/cba0a0ed9c6947e095d7f731683be7c4/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.388658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c04a7dc5d0e4325953028476402a275, user_id=cba0a0ed9c6947e095d7f731683be7c4, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.391301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.424445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1205/2399] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:26 2022] PUT /identity/v3/projects/9c04a7dc5d0e4325953028476402a275/users/cba0a0ed9c6947e095d7f731683be7c4/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:26.435083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.435363 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.435636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.468197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] MFA Rules not processed for user `cba0a0ed9c6947e095d7f731683be7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:26.469586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:26.546550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1195/2400] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:26.551552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.646595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546349-7c6f-46f0-a9cb-9d071f4f56bd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.652701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.653341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.653618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.653899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.654527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.656424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.697698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1206/2401] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:26.701345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.726448 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3283e7f-b2b5-42fc-bc21-2da4212db317 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.790683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:26.803781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.805437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.805867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.806287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.807297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.810627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.838248 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1196/2402] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:26.841868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.853764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea952e66-faaf-4518-a591-b824d61a9742 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.859614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.860365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.861454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.861454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.861826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.863978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.879004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1207/2403] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:26.880541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.891835 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652ae6-a5b8-44d5-ad7e-f7fd6a273aa7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.897563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.898348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.898692 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.898972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.899738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.901624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8e784-a86d-4c35-b407-82dcddd89ee3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.912634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1197/2404] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:26.917596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:26.928611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c267-ad68-4ff4-a2ee-488844487984 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:26.934190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:26.934874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.935153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.935426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] PATH_INFO: `/v3/projects/bac2857362464c46a9e8b4db6a2a9b20/users/a9b65c1bdb8a4c6d9f54d984348e5939/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:26.951746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac2857362464c46a9e8b4db6a2a9b20, user_id=a9b65c1bdb8a4c6d9f54d984348e5939, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:26.954386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:26.969084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1208/2405] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:26 2022] PUT /identity/v3/projects/bac2857362464c46a9e8b4db6a2a9b20/users/a9b65c1bdb8a4c6d9f54d984348e5939/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:26.987342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:26.987645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:26.987921 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.034167 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] MFA Rules not processed for user `a9b65c1bdb8a4c6d9f54d984348e5939`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:27.035457 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:27.109012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1198/2406] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:27.114541 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.194494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe5246-17ff-4d69-810d-4ef93028783f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.200064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.200669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.200984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.201258 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.201962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.203808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.232175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1209/2407] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:27 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:27.236479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.248014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b18e-56a1-4a7d-b112-1840a871ea57 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.307051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.307666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.307943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.308210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.308877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.310861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.336395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1199/2408] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:27 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:27.341457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.355361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc7b1f-7765-4872-a91e-caf6488032d1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.362644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.363596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.364087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.364542 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.365691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.369223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.372671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:27.390397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1210/2409] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:27.394758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.406076 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aa91c-5ac0-422d-843d-15f9ecd34447 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.418042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.418728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.419006 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.419280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] PATH_INFO: `/v3/projects/01bf973ae51f44f68e802b46012dab27/users/6aaeb762adef41e5bf1231a8fb99add4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.438188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bf973ae51f44f68e802b46012dab27, user_id=6aaeb762adef41e5bf1231a8fb99add4, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.441364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.456298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1200/2410] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:27 2022] PUT /identity/v3/projects/01bf973ae51f44f68e802b46012dab27/users/6aaeb762adef41e5bf1231a8fb99add4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:27.461149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.471860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ff76-06e7-4d93-a343-844d78183a9c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.535688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.536301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.536580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.536886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.537563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.539237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d069-0762-4596-a695-0d3834fdc662 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.550797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1211/2411] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:27.557871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.569184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9910bd-5a95-4da5-805b-eb5107ffac96 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.575599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.576437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.576856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.577143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] PATH_INFO: `/v3/projects/01bf973ae51f44f68e802b46012dab27/users/6aaeb762adef41e5bf1231a8fb99add4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.579338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bf973ae51f44f68e802b46012dab27, user_id=6aaeb762adef41e5bf1231a8fb99add4, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.582043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.596505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1201/2412] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:27 2022] PUT /identity/v3/projects/01bf973ae51f44f68e802b46012dab27/users/6aaeb762adef41e5bf1231a8fb99add4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:27.607297 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.607608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.607886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.641576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] MFA Rules not processed for user `6aaeb762adef41e5bf1231a8fb99add4`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:27.642835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:27.720331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1212/2413] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:27.732392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:27.734237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:27.754027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:27.804634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba2966-5271-4350-9c65-079380eb0195 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:27.804634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:27.804634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:27.804634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:27.805412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:27.814929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:27.816401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:27.826498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1202/2414] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:28.423141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:28.424672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:28.437781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11277f-1a19-413f-b0a5-7b2d250ba482 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:28.441667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:28.442276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:28.442554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:28.442820 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:28.502072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:28.503525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:28.514566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1213/2415] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:32.745652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:32.755217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a2125-ece4-4c33-b0cd-371b02b19427 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:32.761821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:32.762495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:32.762708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:32.762981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:32.835229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:32.836729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123651-8476-40f1-ac35-966a07274011 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:32.848510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1203/2416] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:35.235605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:35.266392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:35.327993 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1177a-5713-4adb-b562-a370ddde08f2 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:35.332896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:35.333532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:35.333808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:35.334073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] PATH_INFO: `/v3/users/cba0a0ed9c6947e095d7f731683be7c4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:35.335276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba0a0ed9c6947e095d7f731683be7c4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:35.337415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:35.405045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba0a0ed9c6947e095d7f731683be7c4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:35.405045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba0a0ed9c6947e095d7f731683be7c4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:35.411101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba0a0ed9c6947e095d7f731683be7c4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:35.424924 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba0a0ed9c6947e095d7f731683be7c4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:35.433192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba0a0ed9c6947e095d7f731683be7c4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:35.439389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1214/2417] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:35 2022] DELETE /identity/v3/users/cba0a0ed9c6947e095d7f731683be7c4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:35.443888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:35.445182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:35.445535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:35.465385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:35.466669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:35.533900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1204/2418] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:35.544506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:35.545985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:35.618984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601d0-fea6-4b55-9cc9-ebd00f5dd021 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:35.622825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:35.623547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:35.623868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:35.624138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:35.634899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:35.636326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:35.647012 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1215/2419] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:35.940534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:35.942375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:35.958573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca87a-aeb3-4577-9572-0fb3b9c28a2e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:35.971535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:35.972374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:35.972856 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:35.973364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] PATH_INFO: `/v3/projects/9c04a7dc5d0e4325953028476402a275` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:35.974859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c04a7dc5d0e4325953028476402a275)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:35.977557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:36.034018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c04a7dc5d0e4325953028476402a275', 'request_id': 'req-6014fe2b-7c25-4afe-881d-263dba770552'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.035912 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:36.041605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c04a7dc5d0e4325953028476402a275', 'request_id': 'req-6014fe2b-7c25-4afe-881d-263dba770552'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.051027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c04a7dc5d0e4325953028476402a275', 'request_id': 'req-6014fe2b-7c25-4afe-881d-263dba770552'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.063771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] The token cache is being invalidate because project 9c04a7dc5d0e4325953028476402a275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:36.064062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.064889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.066392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1205/2420] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:35 2022] DELETE /identity/v3/projects/9c04a7dc5d0e4325953028476402a275 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:36.071710 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:36.081561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c234-a3d2-478d-94ed-c143466056ab service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:36.122504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:36.142107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:36.142726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:36.143002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:36.143267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] PATH_INFO: `/v3/users/a9b65c1bdb8a4c6d9f54d984348e5939` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:36.144621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b65c1bdb8a4c6d9f54d984348e5939)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:36.146554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:36.192278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b65c1bdb8a4c6d9f54d984348e5939'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.192881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b65c1bdb8a4c6d9f54d984348e5939'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.200050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b65c1bdb8a4c6d9f54d984348e5939'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.212315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b65c1bdb8a4c6d9f54d984348e5939'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.219000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b65c1bdb8a4c6d9f54d984348e5939'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.224743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1216/2421] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:36 2022] DELETE /identity/v3/users/a9b65c1bdb8a4c6d9f54d984348e5939 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:36.513027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:36.515013 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:36.531122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014fe2b-7c25-4afe-881d-263dba770552 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:36.596681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:36.597423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:36.597700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:36.597970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] PATH_INFO: `/v3/projects/bac2857362464c46a9e8b4db6a2a9b20` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:36.599093 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac2857362464c46a9e8b4db6a2a9b20)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:36.601690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:36.659993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac2857362464c46a9e8b4db6a2a9b20', 'request_id': 'req-64b821a1-6c40-43b9-97d7-a26988b8fa11'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.666836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac2857362464c46a9e8b4db6a2a9b20', 'request_id': 'req-64b821a1-6c40-43b9-97d7-a26988b8fa11'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.674732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac2857362464c46a9e8b4db6a2a9b20', 'request_id': 'req-64b821a1-6c40-43b9-97d7-a26988b8fa11'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.686389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] The token cache is being invalidate because project bac2857362464c46a9e8b4db6a2a9b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:36.686670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.687307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-64b821a1-6c40-43b9-97d7-a26988b8fa11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.688784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1206/2422] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:36 2022] DELETE /identity/v3/projects/bac2857362464c46a9e8b4db6a2a9b20 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:36.692677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:36.694082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:36.707272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f510e-498a-4791-91ac-f8eaf4136ebc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:36.769760 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:36.770454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:36.770737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:36.771011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] PATH_INFO: `/v3/users/6aaeb762adef41e5bf1231a8fb99add4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:36.772134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aaeb762adef41e5bf1231a8fb99add4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:36.775124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:36.825472 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aaeb762adef41e5bf1231a8fb99add4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.826210 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aaeb762adef41e5bf1231a8fb99add4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.833695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aaeb762adef41e5bf1231a8fb99add4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.839804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:36.849090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aaeb762adef41e5bf1231a8fb99add4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.858428 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aaeb762adef41e5bf1231a8fb99add4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:36.865191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1217/2423] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:36 2022] DELETE /identity/v3/users/6aaeb762adef41e5bf1231a8fb99add4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:36.986412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:36.987152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:36.987431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.007495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:37.008783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:37.071906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1207/2424] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:37.084664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.086731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:37.149401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.151709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:37.160956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf8434-3057-4419-8bf4-0f739b87958d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.167278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.167894 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.168184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.168530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.177343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.179750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374195c7-5d55-453e-8aa6-2dc1e0834b7d service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.184593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:37.189856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1218/2425] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:52:37.240208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a585-d7a9-4023-818d-c7149e3375ba None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.244941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.245568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.245879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.246099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] PATH_INFO: `/v3/projects/01bf973ae51f44f68e802b46012dab27` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.247589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bf973ae51f44f68e802b46012dab27)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.249683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.301898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bf973ae51f44f68e802b46012dab27', 'request_id': 'req-bb6950a0-276b-492e-847c-cd1031bf746f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:37.311485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bf973ae51f44f68e802b46012dab27', 'request_id': 'req-bb6950a0-276b-492e-847c-cd1031bf746f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:37.322129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bf973ae51f44f68e802b46012dab27', 'request_id': 'req-bb6950a0-276b-492e-847c-cd1031bf746f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:37.339257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] The token cache is being invalidate because project 01bf973ae51f44f68e802b46012dab27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:37.339654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:37.341152 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bb6950a0-276b-492e-847c-cd1031bf746f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:37.344179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1208/2426] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:37 2022] DELETE /identity/v3/projects/01bf973ae51f44f68e802b46012dab27 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:37.349166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.349836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.350267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.387624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:37.389212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:37.474622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1219/2427] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:37.485908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.486245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.486496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.512131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:37.513385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:37.523184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1209/2428] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:37.527228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.544405 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce440e66-f89f-4021-ae39-02b871964750 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.551646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.554547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.554836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.555109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.555784 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:37.556089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.557757 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.576221 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1220/2429] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:52:37.580604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.595590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839c526-a9a7-4552-8afa-fc415b5960a9 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.601475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.602722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.603198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.604377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.605246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.607959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.652595 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1210/2430] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:37 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:37.657376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.676343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb8a88-6054-46d4-99e4-8faa340c0d9f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.758160 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:37.763251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.763892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.764168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.764438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.765140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.767112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.799577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1221/2431] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:37 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:37.808062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.827196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05ef40-a0e0-4e82-9add-1b879bbaddb4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.834572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.837337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.837879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.838391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.840924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.843765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.856806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1211/2432] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:37.861399 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.877098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414463aa-6b75-47db-9aae-b31a38e87b42 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.881512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.883840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.884121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.884397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:37.885419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:37.888625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c1d65-d6c2-49d7-a0ba-0f8dbbe9f0d9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:37.903564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1222/2433] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:37.974056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:37.985838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2e4d4-a44d-4afc-a67f-9bdf2781acfa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:37.992504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:37.993899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:37.994404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:37.994745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] PATH_INFO: `/v3/projects/9220af20d3034a259e691b717ab37c51/users/7c5f9e864856468d80a1ed582337819a/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.018515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9220af20d3034a259e691b717ab37c51, user_id=7c5f9e864856468d80a1ed582337819a, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.021722 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.043795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1212/2434] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:37 2022] PUT /identity/v3/projects/9220af20d3034a259e691b717ab37c51/users/7c5f9e864856468d80a1ed582337819a/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:38.054144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.055206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.055516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.090805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] MFA Rules not processed for user `7c5f9e864856468d80a1ed582337819a`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:38.092379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:38.180895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1223/2435] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:38.185442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.238920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:38.261811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e242fc-f82e-468b-9c59-bedaa2a8419b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.267243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.267903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.268182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.268454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.269158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.271430 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.302344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1213/2436] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:38 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:38.307376 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.318475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1babeb-6b72-4d58-a844-642d4976d0a6 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.377512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.378117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.378393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.378661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.379375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.382202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.406294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1224/2437] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:38 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:38.410668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.421191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc687ff-63ca-4eef-8b55-dacfe034a1d2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.425876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.426470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.426749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.427022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.427657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.429864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.440521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1214/2438] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:38.445673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.455554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273976bb-ee6e-40aa-81b8-2b47fb77cf3a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.460565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.461278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.461552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.461838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] PATH_INFO: `/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a/users/a8afbfc33d3b43f7bc3eb9032e26186d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.477170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d4969ae5641db9664b6bbfb75db1a, user_id=a8afbfc33d3b43f7bc3eb9032e26186d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.479869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.494316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1225/2439] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:38 2022] PUT /identity/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a/users/a8afbfc33d3b43f7bc3eb9032e26186d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:38.498236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.508424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cbc83-aadb-4680-b647-59dc60ca06fa admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.564503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.565366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.565468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.565669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.566300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.567918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0bca5-843d-42c6-8131-baf310f38398 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.577945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1215/2440] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:38.582130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.592678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9ca7e-ef20-4451-86bc-754f3336d25a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.597360 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.598026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.598300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.598570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] PATH_INFO: `/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a/users/a8afbfc33d3b43f7bc3eb9032e26186d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.601203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5d4969ae5641db9664b6bbfb75db1a, user_id=a8afbfc33d3b43f7bc3eb9032e26186d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.603991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.614469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1226/2441] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:38 2022] PUT /identity/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a/users/a8afbfc33d3b43f7bc3eb9032e26186d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:38.626605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.626881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.627154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.655978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] MFA Rules not processed for user `a8afbfc33d3b43f7bc3eb9032e26186d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:38.657230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:38.729461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1216/2442] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:38.741715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.743415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:38.762995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:38.803497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf752f-aa7f-4749-94a2-c3aed5e2e325 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.808364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.809011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.809289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.809557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.820175 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:38.821629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:38.831302 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1227/2443] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:38.921654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:38.931795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da7dc9-f1a8-439d-b3dd-a976270c872c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:38.936023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:38.936274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:38.936546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:38.936845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:38.973671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:39.000471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:39.001964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9e6b2-3374-4706-9644-c280329dcf72 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:39.011973 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1217/2444] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:39.294433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:39.359650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd7c23-f04e-40b6-ba2b-dea0912babd9 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:39.364191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:39.364887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:39.365203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:39.365406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] PATH_INFO: `/v3/users/7c5f9e864856468d80a1ed582337819a` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:39.367306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5f9e864856468d80a1ed582337819a)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:39.369251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:39.415824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5f9e864856468d80a1ed582337819a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.416470 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5f9e864856468d80a1ed582337819a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.428222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5f9e864856468d80a1ed582337819a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.441140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5f9e864856468d80a1ed582337819a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.447939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5f9e864856468d80a1ed582337819a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.453836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1228/2445] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:39 2022] DELETE /identity/v3/users/7c5f9e864856468d80a1ed582337819a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:39.458490 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:39.458776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:39.459050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:39.478629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:39.479834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:39.536992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1218/2446] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:39.547178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:39.548632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:39.593889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:39.610468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ed708-2463-4e35-9ced-affa3b15bf70 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:39.614115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:39.614725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:39.615004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:39.615277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:39.624980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:39.626418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:39.636371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1229/2447] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:39.909354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:39.910824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:39.923861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad6883-20a2-4e4b-8b1a-e9e7c7d73479 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:39.928563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:39.929228 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:39.929515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:39.929783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] PATH_INFO: `/v3/projects/9220af20d3034a259e691b717ab37c51` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:39.930913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9220af20d3034a259e691b717ab37c51)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:39.932868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:39.982986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9220af20d3034a259e691b717ab37c51', 'request_id': 'req-9ae9fb67-f63d-45d6-af01-34766103fc45'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.989104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9220af20d3034a259e691b717ab37c51', 'request_id': 'req-9ae9fb67-f63d-45d6-af01-34766103fc45'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:39.996734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9220af20d3034a259e691b717ab37c51', 'request_id': 'req-9ae9fb67-f63d-45d6-af01-34766103fc45'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.008325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] The token cache is being invalidate because project 9220af20d3034a259e691b717ab37c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:40.008664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.009381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.010878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1219/2448] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:39 2022] DELETE /identity/v3/projects/9220af20d3034a259e691b717ab37c51 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:40.014911 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:40.026406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823fd34-0c00-45af-85a8-8d741f49e2f9 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:40.082293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:40.082823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.083096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.083364 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] PATH_INFO: `/v3/users/a8afbfc33d3b43f7bc3eb9032e26186d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.084478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8afbfc33d3b43f7bc3eb9032e26186d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:40.087022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:40.130847 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8afbfc33d3b43f7bc3eb9032e26186d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.132110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8afbfc33d3b43f7bc3eb9032e26186d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.139565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8afbfc33d3b43f7bc3eb9032e26186d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.151992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8afbfc33d3b43f7bc3eb9032e26186d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.159256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0becb4e8-1455-4a58-906d-1864babfbbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8afbfc33d3b43f7bc3eb9032e26186d'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.165377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1230/2449] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:40 2022] DELETE /identity/v3/users/a8afbfc33d3b43f7bc3eb9032e26186d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:40.460147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:40.462031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:40.487550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9fb67-f63d-45d6-af01-34766103fc45 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:40.559370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:40.560000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.560278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.560695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] PATH_INFO: `/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.562197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5d4969ae5641db9664b6bbfb75db1a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:40.564777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:40.566464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:40.629986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5d4969ae5641db9664b6bbfb75db1a', 'request_id': 'req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.646791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5d4969ae5641db9664b6bbfb75db1a', 'request_id': 'req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.669225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5d4969ae5641db9664b6bbfb75db1a', 'request_id': 'req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.683645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] The token cache is being invalidate because project 2c5d4969ae5641db9664b6bbfb75db1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:40.683800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.684515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-aa6ba0b4-fe7d-43e7-99ae-320d45a83f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:40.686061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1220/2450] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:40 2022] DELETE /identity/v3/projects/2c5d4969ae5641db9664b6bbfb75db1a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:40.692007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.692300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.692713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.717807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:40.719366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:40.776604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:40.793214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1231/2451] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:40.802116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.802399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.802673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.827455 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:40.828888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:40.840984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1221/2452] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:40.842193 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:40.853823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337af80d-108d-47fe-aea5-1da850c6e341 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:40.858741 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:40.859413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.859687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.859954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.860605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:40.860958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:40.862610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:40.876531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1232/2453] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:40.880648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:40.891256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1195e-732f-462d-9272-e6ba87860fce None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:40.896151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:40.896745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:40.897046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:40.898058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:40.898705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:40.900610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:40.929590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1222/2454] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:40.933746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:40.946096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c33fa-9daf-42aa-97b9-35545cfba715 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.009638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.010263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.010579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.010818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.011502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.013578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.039152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1233/2455] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:40 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:41.040800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.051650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054ee3b-a6a4-4a3d-bd7a-29cde27af870 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.056724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.057329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.057606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.057906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.058575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.060965 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.076828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1223/2456] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:41.078910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.091956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e3029-5f0d-4b7c-803b-d6625cecaec1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.096982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.097592 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.097889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.098140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.098776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.100408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e0397-1918-4ba2-9d4d-2ef5b8ca50b2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.114013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1234/2457] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:41.120384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.132327 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231b76-4dfd-4dfc-b808-b8bb0be68c37 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.137989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.139505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.139505 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.139816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] PATH_INFO: `/v3/projects/da68445eed7f4cd58ed38aaf8d03e09c/users/2f6de83500f043c6a2b5a0bf4a57bad8/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.166174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da68445eed7f4cd58ed38aaf8d03e09c, user_id=2f6de83500f043c6a2b5a0bf4a57bad8, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.168907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.185691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1224/2458] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:41 2022] PUT /identity/v3/projects/da68445eed7f4cd58ed38aaf8d03e09c/users/2f6de83500f043c6a2b5a0bf4a57bad8/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:41.197432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.197713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.198009 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.230786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] MFA Rules not processed for user `2f6de83500f043c6a2b5a0bf4a57bad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.232154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:41.313770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1235/2459] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:41.319062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.430969 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bf684-d291-436c-8525-3474b5542f96 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.440569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.441984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.442279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.442559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.443413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.446521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.495442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1225/2460] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:41.500222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.533640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c6d8-f866-4c13-a4b9-98d086a1444c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.623948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:41.638400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.639153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.639403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.639798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.640460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.642918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.679806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1236/2461] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:41.685677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.702971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a3e4f-7a18-4a8e-9e5b-f6d84de26c17 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.708138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.709383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.709383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.709383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.710546 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.711771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.720202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:41.727147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1226/2462] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:41.732086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.748888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061efe1d-3d1a-4e61-9490-115221fce6ac admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.755740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.757460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.758070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.758350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.759023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.760666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea183f8f-54aa-4dd1-810e-9166695a4158 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.776562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1237/2463] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:41.778839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.800811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad323fd7-7343-48dd-b501-0f660ff768cf admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.814883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.816182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.816182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.816182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] PATH_INFO: `/v3/projects/a0c671dfdc714b0287b7aab558cd45e9/users/be1839a4e6c34b2abf38e8cad5ef8d13/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.839434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0c671dfdc714b0287b7aab558cd45e9, user_id=be1839a4e6c34b2abf38e8cad5ef8d13, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.842601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.862121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1227/2464] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:41 2022] PUT /identity/v3/projects/a0c671dfdc714b0287b7aab558cd45e9/users/be1839a4e6c34b2abf38e8cad5ef8d13/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:41.875149 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.875480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.875833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.922469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] MFA Rules not processed for user `be1839a4e6c34b2abf38e8cad5ef8d13`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.923602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.021408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1238/2465] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.026370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.117236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18005134-53e0-4e5f-9da5-114e251ef89c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.122771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.123468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.123750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.124412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.124651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.126626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.160800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1228/2466] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.163804 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.175867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8543e-8648-4f42-a2da-238ecd1a2930 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.238146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.238764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.239042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.239318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.239959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.242099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.265184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1239/2467] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.269785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.283953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7b33-01f0-4983-9c2c-ff105b160c5f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.288672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.289318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.289596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.289868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.290506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.292105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.305092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1229/2468] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:42.309487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.320555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1fda-f366-4356-8c37-238ffeb0c609 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.325274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.325938 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.326219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.326496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] PATH_INFO: `/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2/users/8bc2335169a24cf1bd0406b69c73137e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.344901 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbade88c3b44c3f8520eb8757a4b1d2, user_id=8bc2335169a24cf1bd0406b69c73137e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.348974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.365891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1240/2469] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:42 2022] PUT /identity/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2/users/8bc2335169a24cf1bd0406b69c73137e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:42.371057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.382435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134031-1d2f-49ee-aa99-d53274099fc6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.444834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.445446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.445724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.445997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.446792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.448396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e21093-94d4-4d08-9a65-49ffb6095dec admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.461289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1230/2470] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:42.464379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.475898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762bc7-fe1d-4d9f-8540-ada67bc3925e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.481019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.481683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.481958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.482228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] PATH_INFO: `/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2/users/8bc2335169a24cf1bd0406b69c73137e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.484203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbade88c3b44c3f8520eb8757a4b1d2, user_id=8bc2335169a24cf1bd0406b69c73137e, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.486956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.500531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1241/2471] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:42 2022] PUT /identity/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2/users/8bc2335169a24cf1bd0406b69c73137e/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:42.508794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.509090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.509369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.540664 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] MFA Rules not processed for user `8bc2335169a24cf1bd0406b69c73137e`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.541930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.578619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.616624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1231/2472] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.628717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.630473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.651287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.699441 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53764f39-1d08-408a-b534-58880f4c8f75 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.703685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.704341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.704602 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.704933 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.763212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.764651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.773857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1242/2473] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:44.332025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.333456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.348619 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7242-55b2-4d15-bef1-fe3e014a47b4 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.353598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.354207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.354486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.354758 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.417441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.418980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.428795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1232/2474] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:44.951834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.960408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4158d4-8e08-4853-af84-e3875d323388 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.964018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.964605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.964909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.965182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.973939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.975345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.984618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1243/2475] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:52:47.439301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:47.441184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:47.510453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c21f8c-4304-41e8-8fe3-a31939fea975 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:47.513906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:47.514475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.514739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.515015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.516788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:47.584372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:47.586144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c511d7-9522-4f6b-844f-00634a99d8b1 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:47.597450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1233/2476] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:48.899936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:48.912371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07112b-0e0b-43ac-b2a5-f34d3ea4a191 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:48.917153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:48.917809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:48.918085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:48.918393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] PATH_INFO: `/v3/users/2f6de83500f043c6a2b5a0bf4a57bad8` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:48.919611 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6de83500f043c6a2b5a0bf4a57bad8)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:48.921604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:48.977161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6de83500f043c6a2b5a0bf4a57bad8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.977879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6de83500f043c6a2b5a0bf4a57bad8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.986023 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6de83500f043c6a2b5a0bf4a57bad8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.000688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6de83500f043c6a2b5a0bf4a57bad8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.008621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6de83500f043c6a2b5a0bf4a57bad8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.015466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1244/2477] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:48 2022] DELETE /identity/v3/users/2f6de83500f043c6a2b5a0bf4a57bad8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:49.020342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:49.020854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:49.020951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:49.040543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:49.041772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:49.056109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:49.104556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1234/2478] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:49.141350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:49.142846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:49.184707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:49.215927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b59b-4438-4e9f-9080-f74e05db884e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:49.223165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:49.223390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:49.223673 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:49.223950 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:49.234694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:49.236131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:49.248970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1245/2479] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:49.838937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:49.840956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:49.856315 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303baca-25f9-40fa-a9dc-eb0e59084088 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:49.862725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:49.863515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:49.863796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:49.864066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] PATH_INFO: `/v3/projects/da68445eed7f4cd58ed38aaf8d03e09c` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:49.865245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=da68445eed7f4cd58ed38aaf8d03e09c)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:49.867518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:49.939613 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da68445eed7f4cd58ed38aaf8d03e09c', 'request_id': 'req-5dfe281f-a3be-41f5-a026-17ec8687d9ac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.947478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da68445eed7f4cd58ed38aaf8d03e09c', 'request_id': 'req-5dfe281f-a3be-41f5-a026-17ec8687d9ac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.958002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da68445eed7f4cd58ed38aaf8d03e09c', 'request_id': 'req-5dfe281f-a3be-41f5-a026-17ec8687d9ac'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.971121 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] The token cache is being invalidate because project da68445eed7f4cd58ed38aaf8d03e09c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:49.971464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.972966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.974769 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1235/2480] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:49 2022] DELETE /identity/v3/projects/da68445eed7f4cd58ed38aaf8d03e09c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:49.980645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:49.992838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be49d6c-4a6d-4386-935d-f03cc8706809 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:50.059830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:50.060502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:50.060805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:50.061085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] PATH_INFO: `/v3/users/be1839a4e6c34b2abf38e8cad5ef8d13` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:50.062238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1839a4e6c34b2abf38e8cad5ef8d13)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:50.064156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:50.127514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1839a4e6c34b2abf38e8cad5ef8d13'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.128124 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1839a4e6c34b2abf38e8cad5ef8d13'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.137119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1839a4e6c34b2abf38e8cad5ef8d13'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.152667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1839a4e6c34b2abf38e8cad5ef8d13'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.159802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1839a4e6c34b2abf38e8cad5ef8d13'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.169301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1246/2481] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:49 2022] DELETE /identity/v3/users/be1839a4e6c34b2abf38e8cad5ef8d13 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:50.457866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:50.460596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:50.482451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe281f-a3be-41f5-a026-17ec8687d9ac admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:50.557632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:50.558382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:50.558794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:50.559134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] PATH_INFO: `/v3/projects/a0c671dfdc714b0287b7aab558cd45e9` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:50.566172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0c671dfdc714b0287b7aab558cd45e9)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:50.570087 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:50.637483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:50.641244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0c671dfdc714b0287b7aab558cd45e9', 'request_id': 'req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.655255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0c671dfdc714b0287b7aab558cd45e9', 'request_id': 'req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.668855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0c671dfdc714b0287b7aab558cd45e9', 'request_id': 'req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.689886 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] The token cache is being invalidate because project a0c671dfdc714b0287b7aab558cd45e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:50.690395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.691074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.695629 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1236/2482] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:50 2022] DELETE /identity/v3/projects/a0c671dfdc714b0287b7aab558cd45e9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:50.696916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:50.698392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:50.715530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d907-9d49-46a5-a4a7-d3d6190fe5b8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:50.777960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:50.800412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:50.801365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:50.801807 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:50.802236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] PATH_INFO: `/v3/users/8bc2335169a24cf1bd0406b69c73137e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:50.809080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc2335169a24cf1bd0406b69c73137e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:50.810946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:50.868424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc2335169a24cf1bd0406b69c73137e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.869123 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc2335169a24cf1bd0406b69c73137e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.878464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc2335169a24cf1bd0406b69c73137e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.894017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc2335169a24cf1bd0406b69c73137e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.902400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc2335169a24cf1bd0406b69c73137e'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.910155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1247/2483] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:50 2022] DELETE /identity/v3/users/8bc2335169a24cf1bd0406b69c73137e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:51.330097 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.331526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.345632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b616e-8fd2-4dae-b1a7-deb42f9c20a8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.372282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.373866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.416485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.417729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.418025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.418285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] PATH_INFO: `/v3/users/9cd5a46657f641e7b0db8684963c0246` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.419468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd5a46657f641e7b0db8684963c0246)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.421473 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.446140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57a24-7d55-44b6-88bb-da0fff92f76d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.452189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.452814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.453092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.453362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] PATH_INFO: `/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.454493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbade88c3b44c3f8520eb8757a4b1d2)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.456657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.481039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd5a46657f641e7b0db8684963c0246'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.491080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd5a46657f641e7b0db8684963c0246'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.491821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd5a46657f641e7b0db8684963c0246'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.492733 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd5a46657f641e7b0db8684963c0246'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.509227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-da5f9671-228b-45d3-bd8c-b8567bfda559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd5a46657f641e7b0db8684963c0246'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.517383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbade88c3b44c3f8520eb8757a4b1d2', 'request_id': 'req-e8afab2e-92b5-43be-a986-33983702f6ed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.525183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1237/2484] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:51 2022] DELETE /identity/v3/users/9cd5a46657f641e7b0db8684963c0246 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:51.526229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbade88c3b44c3f8520eb8757a4b1d2', 'request_id': 'req-e8afab2e-92b5-43be-a986-33983702f6ed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.536010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbade88c3b44c3f8520eb8757a4b1d2', 'request_id': 'req-e8afab2e-92b5-43be-a986-33983702f6ed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.546946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:51.551704 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] The token cache is being invalidate because project 2cbade88c3b44c3f8520eb8757a4b1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:51.552172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.553678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e8afab2e-92b5-43be-a986-33983702f6ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.555482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1248/2485] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:51 2022] DELETE /identity/v3/projects/2cbade88c3b44c3f8520eb8757a4b1d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:51.561295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.562070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.562070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.582932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.584153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.637610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:51.661080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1238/2486] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:51.664512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.664905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.665255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.686523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.688010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.698026 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1249/2487] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:51.702423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.714053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33512440-85f3-4ee1-a093-06c219f8a229 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.719384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.720197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.720715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.721217 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.721334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.722237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:51.722615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.722814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.724380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.743776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1239/2488] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:51.744951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.749763 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c5e98-82a3-46ff-9ded-b913852c3cd8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.755150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.758292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] PATH_INFO: `/v3/projects/c32481e5466241338c93569dec7ad0bf` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.759085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3963ab-8342-4f71-a19d-a1a45fad8246 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.759278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32481e5466241338c93569dec7ad0bf)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.761002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.762780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.763396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.763999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.763999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.764564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.766557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.801011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1240/2489] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:51.804876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.821296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32481e5466241338c93569dec7ad0bf', 'request_id': 'req-62da110a-e221-4365-afec-86d59dcfad2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.827528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32481e5466241338c93569dec7ad0bf', 'request_id': 'req-62da110a-e221-4365-afec-86d59dcfad2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.836694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32481e5466241338c93569dec7ad0bf', 'request_id': 'req-62da110a-e221-4365-afec-86d59dcfad2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.847268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] The token cache is being invalidate because project c32481e5466241338c93569dec7ad0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:51.847553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.848179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-62da110a-e221-4365-afec-86d59dcfad2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.850662 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1250/2490] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:51 2022] DELETE /identity/v3/projects/c32481e5466241338c93569dec7ad0bf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:51.854913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c14f-545d-4f45-84eb-0736b94583d7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.855374 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c14f-545d-4f45-84eb-0736b94583d7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.855678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c14f-545d-4f45-84eb-0736b94583d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.871897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207da5-30b6-45fa-a519-6bce54e339bc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.875822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-09d8c14f-545d-4f45-84eb-0736b94583d7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.877059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-09d8c14f-545d-4f45-84eb-0736b94583d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.932293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.933095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.933095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.933377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.934020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.936126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.940086 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1251/2491] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:51.949028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.949315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.949643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.960665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1241/2492] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:51.964882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.966517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.972419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.973657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.978707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771d0d6-17df-4967-af69-cbf404ee9c41 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.982646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1252/2493] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:51.983704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.984360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.984639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.984951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.985608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.986909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.987241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.996039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209dcfe-8981-43ad-ab36-b6b913a246d5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.000556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1242/2494] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:52.001064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.001510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.001707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.001962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.002218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.002947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:52.003313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.004942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.011933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973be9-7ef5-41ee-b957-72d12512ec18 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.016610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.017222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.017500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.017606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1253/2495] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:52:52.017767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.018424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.020301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.023036 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.032428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1243/2496] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:52.032946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fda60-1425-47f9-97c9-6f43ee681e5b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.036421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.039263 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.039895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.040167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.040552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.041227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.044038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.046713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe87e0f-f43f-49d4-9a2e-f34025553aad admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.051799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.052435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.052714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.053609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] PATH_INFO: `/v3/projects/54f01532c7944688bea827703a20ed0b/users/0b676718738d4f469e09d2c6abaf9d5f/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.069631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f01532c7944688bea827703a20ed0b, user_id=0b676718738d4f469e09d2c6abaf9d5f, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.072427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f05677-e756-41f5-a0a0-0f289cfd4bd1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.074350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1254/2497] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:52.078929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.087140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1244/2498] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:52 2022] PUT /identity/v3/projects/54f01532c7944688bea827703a20ed0b/users/0b676718738d4f469e09d2c6abaf9d5f/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:52.098642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.099046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.099429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.121596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.124029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.134947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] MFA Rules not processed for user `0b676718738d4f469e09d2c6abaf9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:52.136897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.146758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac160136-fbce-4d48-8826-d6ac1dbbf0f9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.204621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.205169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.205323 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1245/2499] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:52.205469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.205695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.206327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.208249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.218594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.220422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.233435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1255/2500] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:52.237619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.249984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a788d-7067-4d04-832c-93e08b2bee18 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.254770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.255372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.255653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.255927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.257603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.259260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.269956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1256/2501] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:52.275325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.286463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7686721-f1c9-4d3c-8596-f012cc1c087f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.289335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d5534-7c68-4e11-a820-699bf8b33b4c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.293365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.294012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.294289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.294556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.296336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.296966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.297248 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.297522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.298222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.299974 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.304547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.306533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107ea09-d4c4-4782-bf52-cb3d719155b3 service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.311890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1257/2502] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:52.316214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.320389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1246/2503] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:52:52.327357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143fc71-7311-4ac1-b02b-48b4da8438cb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.332379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.333067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.333431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.333604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] PATH_INFO: `/v3/projects/93cd666a6e02408697a8820ccd39f042/users/974bf3cf564f4be888bfa096457169d8/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.352496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93cd666a6e02408697a8820ccd39f042, user_id=974bf3cf564f4be888bfa096457169d8, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.355240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.377096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1258/2504] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:52 2022] PUT /identity/v3/projects/93cd666a6e02408697a8820ccd39f042/users/974bf3cf564f4be888bfa096457169d8/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:52.390504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.390818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.391062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.421128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] MFA Rules not processed for user `974bf3cf564f4be888bfa096457169d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:52.422328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.492178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1247/2505] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:52.496730 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.564000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91e73-6952-4dc0-874f-070037206341 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.570055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.570672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.570954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.571230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.571878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.573852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.603769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1259/2506] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:52.608462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.620265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eac4b-939a-41d5-ab80-4cef8435740e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.652746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.681949 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.682555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.682840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.683110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.683779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.685765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.716699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.720943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1248/2507] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:52.729153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd643fd1-1cbb-4c45-926b-655a2a0ad44b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.734796 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.735534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.735910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.736292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.737120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.738891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.751531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.763731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1260/2508] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:52.766390 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.783297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637846e-4332-4bdf-b369-4a4812947515 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.791983 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.792876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.793400 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.793906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] PATH_INFO: `/v3/projects/e1f44b79018547cc8d3973dd967899e5/users/cd07220d9aac4014a50aed637ac22d92/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.812055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f44b79018547cc8d3973dd967899e5, user_id=cd07220d9aac4014a50aed637ac22d92, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.815009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.835709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1249/2509] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:52 2022] PUT /identity/v3/projects/e1f44b79018547cc8d3973dd967899e5/users/cd07220d9aac4014a50aed637ac22d92/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:52.839878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.850319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b671-64e9-4658-838f-294faffab7ab admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.909918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.910561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.910839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.911110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.911750 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.913947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af63c2-1b98-47f9-96f3-c22c1328cb9e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.924312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1261/2510] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:52.929305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.939694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95898d87-92c9-40e5-adb2-89296ff45b87 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.944477 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.945172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.945452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.945723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] PATH_INFO: `/v3/projects/e1f44b79018547cc8d3973dd967899e5/users/cd07220d9aac4014a50aed637ac22d92/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.947687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f44b79018547cc8d3973dd967899e5, user_id=cd07220d9aac4014a50aed637ac22d92, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.950413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.961407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1250/2511] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:52 2022] PUT /identity/v3/projects/e1f44b79018547cc8d3973dd967899e5/users/cd07220d9aac4014a50aed637ac22d92/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:52.971647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.971931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.972200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.003148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] MFA Rules not processed for user `cd07220d9aac4014a50aed637ac22d92`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:53.004642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.084038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1262/2512] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:53.096945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.098658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.167342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505430e-191b-45df-9243-c5a5fa526463 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.172028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.172634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.172978 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.173257 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.182842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.184328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0606476-f10e-4236-97f5-65a551211d01 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.194487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1251/2513] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:53.225598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.302207 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18397b13-17bd-4df8-94c5-94aa210a391d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.307590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.308256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.308533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.308836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] PATH_INFO: `/v3/users/974bf3cf564f4be888bfa096457169d8` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.309973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] RBAC: Authorizing `identity:delete_user(user_id=974bf3cf564f4be888bfa096457169d8)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.311898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.340098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:53.365561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974bf3cf564f4be888bfa096457169d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.366355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974bf3cf564f4be888bfa096457169d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.373631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974bf3cf564f4be888bfa096457169d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.389969 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974bf3cf564f4be888bfa096457169d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.398183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974bf3cf564f4be888bfa096457169d8'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.404110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1263/2514] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:53 2022] DELETE /identity/v3/users/974bf3cf564f4be888bfa096457169d8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:53.408690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.409003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.409273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.431283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:53.432680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.512514 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1252/2515] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:53.523138 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.524545 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.582991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa3ee-41d2-47fa-879f-2feae4ca618a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.587805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.588447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.588867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.589625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.599091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.603745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.614203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1264/2516] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:53.894582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.896117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.910300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c976a5-cf28-487e-91f0-2fdfc0944c14 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.916203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.917576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.917844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.918262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] PATH_INFO: `/v3/projects/93cd666a6e02408697a8820ccd39f042` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.919632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93cd666a6e02408697a8820ccd39f042)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.921720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.949634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:53.975780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93cd666a6e02408697a8820ccd39f042', 'request_id': 'req-30a1fb52-25a1-4efc-8dfe-22088c0c4063'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.984311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93cd666a6e02408697a8820ccd39f042', 'request_id': 'req-30a1fb52-25a1-4efc-8dfe-22088c0c4063'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.993336 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93cd666a6e02408697a8820ccd39f042', 'request_id': 'req-30a1fb52-25a1-4efc-8dfe-22088c0c4063'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.004358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] The token cache is being invalidate because project 93cd666a6e02408697a8820ccd39f042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:54.004642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.005344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.007025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1253/2517] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:53 2022] DELETE /identity/v3/projects/93cd666a6e02408697a8820ccd39f042 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:54.011250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.021426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d31fc-4888-49e3-ac65-21b45cbe7763 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.085024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.085780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.086106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.086484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] PATH_INFO: `/v3/users/cd07220d9aac4014a50aed637ac22d92` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.088261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd07220d9aac4014a50aed637ac22d92)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.090544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.139118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:54.141146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd07220d9aac4014a50aed637ac22d92'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.141891 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd07220d9aac4014a50aed637ac22d92'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.155075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd07220d9aac4014a50aed637ac22d92'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.168649 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd07220d9aac4014a50aed637ac22d92'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.176072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-4bb42d38-583d-4aa4-989d-2742f01c1a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd07220d9aac4014a50aed637ac22d92'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.182237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1265/2518] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:54 2022] DELETE /identity/v3/users/cd07220d9aac4014a50aed637ac22d92 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:54.481889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.484035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:54.498556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fb52-25a1-4efc-8dfe-22088c0c4063 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.559601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.560297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.560510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.560804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] PATH_INFO: `/v3/projects/e1f44b79018547cc8d3973dd967899e5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.561963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f44b79018547cc8d3973dd967899e5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.563889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.612823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f44b79018547cc8d3973dd967899e5', 'request_id': 'req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.619706 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f44b79018547cc8d3973dd967899e5', 'request_id': 'req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.627642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f44b79018547cc8d3973dd967899e5', 'request_id': 'req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.641116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] The token cache is being invalidate because project e1f44b79018547cc8d3973dd967899e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:54.641402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.642060 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-56c48bbe-5bc9-47a3-8619-a1e64258ae6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.643578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1254/2519] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:54 2022] DELETE /identity/v3/projects/e1f44b79018547cc8d3973dd967899e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:54.649346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.649837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.650018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.670703 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:54.671905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:54.736698 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1266/2520] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:54.744464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.744749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.745055 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.765678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:54.766916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:54.776044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1255/2521] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:54.780406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.791106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c1fef-c93f-45f5-9615-625680124c18 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.795669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.796273 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.796549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.796849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.797497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:54.797798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.799427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.817089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1267/2522] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:54.818366 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.828359 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5274d-1e47-4ab1-a2e5-e01a19074098 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.833238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.833831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.834623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.834935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.835656 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.837601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.867466 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1256/2523] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:54 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:54.875606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.887555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bf91-81fa-40c7-86fe-74a027fd3c67 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.947095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.947695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.947971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.948241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.948909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.950823 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.973044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1268/2524] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:54 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:54.977812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.989642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80c55f-1a24-422e-aa79-06c13439b052 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.994716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.995318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.995607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.995868 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.996569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.998226 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.003789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:55.009902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1257/2525] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:55.013728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.024540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0b20-d86c-47bd-9f69-552cf0b4abd9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.029152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.029742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.030019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.030287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.030922 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.032502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1454-eefa-4a86-9cc0-505b6d95b93d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.045136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1269/2526] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:55.049419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.059571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788445a6-d450-4503-a441-d3f94e2e2c9c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.064243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.064957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.065243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.065518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] PATH_INFO: `/v3/projects/8b8ea928992c431c87fdab57806fe1ed/users/87ea7dc78c2143f28b7b2f944561eaaa/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.080711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8ea928992c431c87fdab57806fe1ed, user_id=87ea7dc78c2143f28b7b2f944561eaaa, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.083444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.097222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1258/2527] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:55 2022] PUT /identity/v3/projects/8b8ea928992c431c87fdab57806fe1ed/users/87ea7dc78c2143f28b7b2f944561eaaa/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:55.109880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.110162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.110435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.138454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] MFA Rules not processed for user `87ea7dc78c2143f28b7b2f944561eaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:55.139583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:55.157517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:55.206708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1270/2528] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:55.212681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.275120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bec616-c215-4f47-91af-c4b3597de53a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.280644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.281365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.281658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.281936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.282586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.285070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.315292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1259/2529] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:55.319956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.330826 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec00817-cb07-484c-96e8-b87ac032829f None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.391255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.391798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.392161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.392440 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.393249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.395837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.419580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1271/2530] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:55.420730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.431704 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb189-ab32-4a0c-af04-f3c51589d826 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.436246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.437000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.437277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.437547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.438181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.439784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.452946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1260/2531] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:55.455671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.467079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62feddc4-6acc-426c-84db-686fa2caf4f2 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.471708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.472306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.472589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.472897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.473564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.476010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1f735-222b-4e82-aacf-e5c5a3a10378 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.485934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1272/2532] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:55.490472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.500597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645271-0301-49c1-945a-37e9ec67120a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.505269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.505947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.506431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.506717 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] PATH_INFO: `/v3/projects/f0ebf00ca3d24319830b6348fd1854e5/users/a1248ec31b604309bfc39c6e7d8e5436/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.524129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ebf00ca3d24319830b6348fd1854e5, user_id=a1248ec31b604309bfc39c6e7d8e5436, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.526869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.540512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1261/2533] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:55 2022] PUT /identity/v3/projects/f0ebf00ca3d24319830b6348fd1854e5/users/a1248ec31b604309bfc39c6e7d8e5436/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:55.550587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.550874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.551180 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.582515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] MFA Rules not processed for user `a1248ec31b604309bfc39c6e7d8e5436`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:55.583926 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:55.658724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1273/2534] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:55.664377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.738433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ca64-f980-4090-b6d5-360884c64d1f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.743220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.743821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.744099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.744370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.745041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.746948 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.778367 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1262/2535] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:55.783682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.795959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48bbe6-f384-43fe-a625-e57eb9e26d5a None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.821177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:55.858560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.859176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.859457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.859733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.860367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.862349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.885365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1274/2536] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:55 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:55.889653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.901352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4387e-1942-4634-b395-d2b13708d3b6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.906191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.906819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.907079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.907352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.908109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.910063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.918424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:55.929104 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1263/2537] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:55.930528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.940867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311c4a6-ef5c-4d82-a224-0091f6f56df4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:55.945780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:55.946438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:55.946727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:55.946977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] PATH_INFO: `/v3/projects/852d748048e8462895ab9e69de50a058/users/e3cbafc2aadf4b91b827cd7d48c62837/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:55.962914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d748048e8462895ab9e69de50a058, user_id=e3cbafc2aadf4b91b827cd7d48c62837, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:55.965624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:55.981121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1275/2538] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:55 2022] PUT /identity/v3/projects/852d748048e8462895ab9e69de50a058/users/e3cbafc2aadf4b91b827cd7d48c62837/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:55.986410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.998040 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b19f3-5630-4b52-8048-64f2fa76cb43 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.057791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.058399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.058680 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.058957 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.059599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.061276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5679e-0153-49b7-9189-80fa680f3a66 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.071513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1264/2539] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:56.075786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.086837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee173-c338-49dc-b568-053366d6048e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.092099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.092944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.093085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.093603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] PATH_INFO: `/v3/projects/852d748048e8462895ab9e69de50a058/users/e3cbafc2aadf4b91b827cd7d48c62837/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.095864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d748048e8462895ab9e69de50a058, user_id=e3cbafc2aadf4b91b827cd7d48c62837, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.098908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.111497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1276/2540] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:56 2022] PUT /identity/v3/projects/852d748048e8462895ab9e69de50a058/users/e3cbafc2aadf4b91b827cd7d48c62837/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:56.123711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.124049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.124262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.155294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] MFA Rules not processed for user `e3cbafc2aadf4b91b827cd7d48c62837`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:56.156515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.227990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1265/2541] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:56.239332 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.241231 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.309041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5d6d7-d350-4076-9f7b-72f507bf76b3 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.313583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.314225 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.314495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.314897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.325810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.327255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.337365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1277/2542] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:56.386280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.387644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.400641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9128e2-b97b-4b9d-8845-00e25c047f21 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.404312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.404955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.405229 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.405498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.465713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.467489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a48a7-abb9-477a-b449-d54a8a72de1d service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.477665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1266/2543] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:59.441686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.505604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a4f34-577b-4cc2-bb33-b32fa6251135 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.511718 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.512359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.512665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.513104 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] PATH_INFO: `/v3/users/87ea7dc78c2143f28b7b2f944561eaaa` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.514276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ea7dc78c2143f28b7b2f944561eaaa)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.516233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.541375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:59.570093 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ea7dc78c2143f28b7b2f944561eaaa'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:59.571369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ea7dc78c2143f28b7b2f944561eaaa'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:59.580365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ea7dc78c2143f28b7b2f944561eaaa'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:59.593899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ea7dc78c2143f28b7b2f944561eaaa'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:59.600840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ea7dc78c2143f28b7b2f944561eaaa'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:59.607394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1278/2544] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:59 2022] DELETE /identity/v3/users/87ea7dc78c2143f28b7b2f944561eaaa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:59.612037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.612705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.612705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.641605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:59.643731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:59.667997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:59.720867 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1267/2545] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:59.731966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.733533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:59.816068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105a9d4-0601-4496-b107-94d14042fcc6 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.819722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.820323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.821250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.821658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.831806 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.833348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.844883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1279/2546] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:00.142426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.143930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.161231 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805bc69-eac8-40d6-acf3-81708b619f7a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.167984 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.169173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.169753 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.170328 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] PATH_INFO: `/v3/projects/8b8ea928992c431c87fdab57806fe1ed` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.172016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8ea928992c431c87fdab57806fe1ed)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.174814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.225763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8ea928992c431c87fdab57806fe1ed', 'request_id': 'req-bed504ce-6761-499a-b1e7-2380d7c8d554'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.232832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8ea928992c431c87fdab57806fe1ed', 'request_id': 'req-bed504ce-6761-499a-b1e7-2380d7c8d554'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.241497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8ea928992c431c87fdab57806fe1ed', 'request_id': 'req-bed504ce-6761-499a-b1e7-2380d7c8d554'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.253847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] The token cache is being invalidate because project 8b8ea928992c431c87fdab57806fe1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:00.254131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.254766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.256232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1268/2547] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:00 2022] DELETE /identity/v3/projects/8b8ea928992c431c87fdab57806fe1ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:00.260595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.271147 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440eda8-a1de-404d-bf29-5e848b32050f service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.329244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.329868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.330144 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.330414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] PATH_INFO: `/v3/users/a1248ec31b604309bfc39c6e7d8e5436` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.331527 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1248ec31b604309bfc39c6e7d8e5436)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.333464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.380665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:00.385216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1248ec31b604309bfc39c6e7d8e5436'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.385875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1248ec31b604309bfc39c6e7d8e5436'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.393812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1248ec31b604309bfc39c6e7d8e5436'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.407431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1248ec31b604309bfc39c6e7d8e5436'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.415188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1248ec31b604309bfc39c6e7d8e5436'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.421803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1280/2548] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:00 2022] DELETE /identity/v3/users/a1248ec31b604309bfc39c6e7d8e5436 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:00.698370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.699883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.716509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed504ce-6761-499a-b1e7-2380d7c8d554 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.776004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.776639 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.776946 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.777219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] PATH_INFO: `/v3/projects/f0ebf00ca3d24319830b6348fd1854e5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.778495 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ebf00ca3d24319830b6348fd1854e5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.780414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.832429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:00.835651 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ebf00ca3d24319830b6348fd1854e5', 'request_id': 'req-85b95906-b231-4d67-8e64-9025d9124635'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.843341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ebf00ca3d24319830b6348fd1854e5', 'request_id': 'req-85b95906-b231-4d67-8e64-9025d9124635'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.851279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ebf00ca3d24319830b6348fd1854e5', 'request_id': 'req-85b95906-b231-4d67-8e64-9025d9124635'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.862498 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] The token cache is being invalidate because project f0ebf00ca3d24319830b6348fd1854e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:00.862782 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.863419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.864928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1269/2549] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:00 2022] DELETE /identity/v3/projects/f0ebf00ca3d24319830b6348fd1854e5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:00.869521 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.870946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.884025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd2bca-a6a3-4c89-a192-934095ecf24d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.942043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.942582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.942861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.943130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] PATH_INFO: `/v3/users/e3cbafc2aadf4b91b827cd7d48c62837` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.944242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3cbafc2aadf4b91b827cd7d48c62837)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.946327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.994382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3cbafc2aadf4b91b827cd7d48c62837'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:00.995048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3cbafc2aadf4b91b827cd7d48c62837'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.002770 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3cbafc2aadf4b91b827cd7d48c62837'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.018758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3cbafc2aadf4b91b827cd7d48c62837'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.026336 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-a1057089-f5f4-4326-a909-dabec7e0b49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3cbafc2aadf4b91b827cd7d48c62837'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.032351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1281/2550] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:00 2022] DELETE /identity/v3/users/e3cbafc2aadf4b91b827cd7d48c62837 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:01.322577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.324136 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.343896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95906-b231-4d67-8e64-9025d9124635 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.409726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.410370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.410650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.410927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] PATH_INFO: `/v3/projects/852d748048e8462895ab9e69de50a058` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.412052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852d748048e8462895ab9e69de50a058)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.414002 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.464987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852d748048e8462895ab9e69de50a058', 'request_id': 'req-9986d491-991b-47dc-b45f-25158c0f2c97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.471443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852d748048e8462895ab9e69de50a058', 'request_id': 'req-9986d491-991b-47dc-b45f-25158c0f2c97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.481252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852d748048e8462895ab9e69de50a058', 'request_id': 'req-9986d491-991b-47dc-b45f-25158c0f2c97'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.495744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] The token cache is being invalidate because project 852d748048e8462895ab9e69de50a058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:01.496083 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.496672 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9986d491-991b-47dc-b45f-25158c0f2c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.498330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1270/2551] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:01 2022] DELETE /identity/v3/projects/852d748048e8462895ab9e69de50a058 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:01.504579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.504893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.505169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.528670 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:01.529829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.571239 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:01.597501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1282/2552] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:01.607878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.608165 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.608440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.629235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:01.630464 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.640942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1271/2553] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:01.643142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.654028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62a909-478c-4bb8-a373-879087aa0e82 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.658643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.659243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.659518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.659794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.660450 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:01.660777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.662477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.677325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1283/2554] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:01.683285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.698898 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32558d-54e3-4554-a891-a379feeec2a8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.705932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.706875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.707325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.707731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.708774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.712964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.751767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1272/2555] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:01.756088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.768243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66057-96a9-451a-be6d-02f3f29979e3 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.839492 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.840119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.840403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.840675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.841353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.843324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.867574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1284/2556] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:01.871985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.884919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badd72c-4370-4de4-bd0c-f127f4c35749 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.889887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.890516 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.890789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.891059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.891701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.893365 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.908899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1273/2557] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:01.910475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.921529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c517b6-0f97-4630-b7ba-85dcb1f848bd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.926434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.927219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.927487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.927789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.928417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.930280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43b9c1-e710-40cc-9b1a-20de3dbb6918 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.944976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1285/2558] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:01.949876 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.960032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400058f7-c74e-4909-80d7-5c76e647b9f3 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.966821 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.967502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.967775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.968050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] PATH_INFO: `/v3/projects/dfd303c02c4740ffa921242deca6e84d/users/fb3894bf6d6740e4a4227ac23c032822/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.985736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd303c02c4740ffa921242deca6e84d, user_id=fb3894bf6d6740e4a4227ac23c032822, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.988450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.998842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:02.004236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1274/2559] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:01 2022] PUT /identity/v3/projects/dfd303c02c4740ffa921242deca6e84d/users/fb3894bf6d6740e4a4227ac23c032822/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:02.010228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db00b-0367-4d52-8860-1d924139126c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.010516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db00b-0367-4d52-8860-1d924139126c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.010780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170db00b-0367-4d52-8860-1d924139126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.035765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-170db00b-0367-4d52-8860-1d924139126c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:02.037038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-170db00b-0367-4d52-8860-1d924139126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.110045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1286/2560] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:02.121117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.123000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.191789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fdd18-494a-4af3-81e6-b049394d2b8f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.196416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.197737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.197737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.197737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.207865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.209524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.220354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1275/2561] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:02.925825 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.926512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.926512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.973328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] MFA Rules not processed for user `fb3894bf6d6740e4a4227ac23c032822`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:02.975203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:03.041621 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:03.088372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1287/2562] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:03.093289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.105441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896e364-7848-40ad-8ac6-c6b99c8ef39b service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.110364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.110972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.111428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.111703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.112358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.114512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.146683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1276/2563] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:03.150835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.163774 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a52e8-7a20-4d42-bca2-8456faa765a8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.245871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.246518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.246850 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.247181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.247836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.249904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.277074 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1288/2564] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:03.278392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.290330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943ce65-e8dd-4668-a875-93d6df9ef93a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.295518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.296291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.296536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.297080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.297673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.299374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.311741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1277/2565] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:03.317015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.330951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d9474-a767-43b4-98ec-0749c7a9c011 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.336897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.337601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.337878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.338151 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] PATH_INFO: `/v3/projects/309d646336cc4d6ca71310a84f5b6bab/users/415edc68fe014799986473b38fa43f8c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.356677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309d646336cc4d6ca71310a84f5b6bab, user_id=415edc68fe014799986473b38fa43f8c, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.359307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.374949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1289/2566] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:03 2022] PUT /identity/v3/projects/309d646336cc4d6ca71310a84f5b6bab/users/415edc68fe014799986473b38fa43f8c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:03.387215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.394517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b249-2d72-429c-b705-dd3da9fe1032 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.457746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.458360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.458640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.458916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.459561 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.462016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1832cc-d999-41f7-82a8-1004b8aa91f1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.473461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1278/2567] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:03.479653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.496691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2a89-6a5a-42b1-a3a9-7d2679c50630 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.503810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.504841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.505321 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.505779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] PATH_INFO: `/v3/projects/309d646336cc4d6ca71310a84f5b6bab/users/415edc68fe014799986473b38fa43f8c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.509830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309d646336cc4d6ca71310a84f5b6bab, user_id=415edc68fe014799986473b38fa43f8c, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.514609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e1530-1173-485d-bf93-684c118a10c4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.530946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1290/2568] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:03 2022] PUT /identity/v3/projects/309d646336cc4d6ca71310a84f5b6bab/users/415edc68fe014799986473b38fa43f8c/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:04.261603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.262437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.262437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.298752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] MFA Rules not processed for user `415edc68fe014799986473b38fa43f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:04.300100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.361939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:04.397489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1279/2569] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:04.399884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.400287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.400495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.423045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] MFA Rules not processed for user `fb3894bf6d6740e4a4227ac23c032822`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:04.424282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.497816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1291/2570] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:04.513415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.515870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.602133 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad9e86-80e4-4d1a-9e31-9bec8987556d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.608518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.609164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.609443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.609716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.619710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.621402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.631790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1280/2571] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:14.489250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=79,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:14.627197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=38 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:20.223767 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:20.225203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:20.285726 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf161-0b79-4d45-bb2a-04d77314e5b3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:20.290381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:20.291028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:20.291304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:20.291577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:20.300846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:20.302272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2da83-2ba8-4d2c-afdb-37e616a954dc service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:20.312275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1292/2572] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:24.959763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:24.961943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:25.036265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe38408-0efd-4a1a-a784-8220ac578bd7 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:25.043745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:25.044388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:25.044695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:25.045005 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] PATH_INFO: `/v3/users/0b676718738d4f469e09d2c6abaf9d5f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:25.046144 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b676718738d4f469e09d2c6abaf9d5f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:25.048085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:25.097621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b676718738d4f469e09d2c6abaf9d5f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.106369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b676718738d4f469e09d2c6abaf9d5f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.107004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b676718738d4f469e09d2c6abaf9d5f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.107683 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b676718738d4f469e09d2c6abaf9d5f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.122160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b676718738d4f469e09d2c6abaf9d5f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.135752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1281/2573] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:24 2022] DELETE /identity/v3/users/0b676718738d4f469e09d2c6abaf9d5f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:25.140444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:25.141411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:25.141684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:25.293972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:25.295085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:25.356008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1293/2574] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:25.368641 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:25.370185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:25.432776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af85ba0-9f9c-4090-800b-723ca7395337 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:25.436410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:25.437042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:25.437322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:25.437592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:25.448106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:25.449587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:25.459258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1282/2575] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:25.730522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:25.732208 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:25.746464 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc62ac0-5b6d-4724-ab29-702a8d4ce8b5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:25.751165 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:25.751824 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:25.752101 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:25.752377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] PATH_INFO: `/v3/projects/54f01532c7944688bea827703a20ed0b` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:25.753529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f01532c7944688bea827703a20ed0b)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:25.755447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:25.804958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f01532c7944688bea827703a20ed0b', 'request_id': 'req-64c28172-3b8f-452c-aabb-33d00c675dfb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.811013 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f01532c7944688bea827703a20ed0b', 'request_id': 'req-64c28172-3b8f-452c-aabb-33d00c675dfb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.818935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f01532c7944688bea827703a20ed0b', 'request_id': 'req-64c28172-3b8f-452c-aabb-33d00c675dfb'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.830102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] The token cache is being invalidate because project 54f01532c7944688bea827703a20ed0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:25.830393 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.831014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:25.832483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1294/2576] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:25 2022] DELETE /identity/v3/projects/54f01532c7944688bea827703a20ed0b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:35.455180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:35.826971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:38.285275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.286922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.300238 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c4d2-77e7-4967-a3e2-1d12f581a256 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.358284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.358891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.359222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.359496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.361265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.426715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.428132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.439415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1283/2577] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:40.627896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.629403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.653015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28172-3b8f-452c-aabb-33d00c675dfb admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.658166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.659482 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.660058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.660599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] PATH_INFO: `/v3/users/fb3894bf6d6740e4a4227ac23c032822` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.662112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3894bf6d6740e4a4227ac23c032822)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.664212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.721828 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3894bf6d6740e4a4227ac23c032822'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.722652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3894bf6d6740e4a4227ac23c032822'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.732486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3894bf6d6740e4a4227ac23c032822'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.748174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3894bf6d6740e4a4227ac23c032822'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.755814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3894bf6d6740e4a4227ac23c032822'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.768627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1295/2578] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:40 2022] DELETE /identity/v3/users/fb3894bf6d6740e4a4227ac23c032822 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:40.962026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.976416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674e3ae-e9c8-4a29-be2a-6ea3376baac3 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.042059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.042771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.043205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.043527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] PATH_INFO: `/v3/projects/dfd303c02c4740ffa921242deca6e84d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.044799 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd303c02c4740ffa921242deca6e84d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.047416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.101703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd303c02c4740ffa921242deca6e84d', 'request_id': 'req-83692dd8-f3c9-4b35-a618-aeb6888d2725'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.105930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:41.111502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd303c02c4740ffa921242deca6e84d', 'request_id': 'req-83692dd8-f3c9-4b35-a618-aeb6888d2725'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.121543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd303c02c4740ffa921242deca6e84d', 'request_id': 'req-83692dd8-f3c9-4b35-a618-aeb6888d2725'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.138827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] The token cache is being invalidate because project dfd303c02c4740ffa921242deca6e84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:41.139269 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.140038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.141842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1284/2579] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:40 2022] DELETE /identity/v3/projects/dfd303c02c4740ffa921242deca6e84d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:41.146090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.147708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.162303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bece85a-7bd4-4609-a34b-93b9a7817629 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.228212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.228986 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.229326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.229708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] PATH_INFO: `/v3/users/415edc68fe014799986473b38fa43f8c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.231353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415edc68fe014799986473b38fa43f8c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.233397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.283394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415edc68fe014799986473b38fa43f8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.284082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415edc68fe014799986473b38fa43f8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.294549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415edc68fe014799986473b38fa43f8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.307849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415edc68fe014799986473b38fa43f8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.311216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:41.315111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-90ae58c8-afb7-4906-84a9-2c7e0f789391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415edc68fe014799986473b38fa43f8c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.322189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1296/2580] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:41 2022] DELETE /identity/v3/users/415edc68fe014799986473b38fa43f8c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:41.518750 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.520494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.550033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83692dd8-f3c9-4b35-a618-aeb6888d2725 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.657575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.663459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.663740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.664275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] PATH_INFO: `/v3/projects/309d646336cc4d6ca71310a84f5b6bab` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.670526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309d646336cc4d6ca71310a84f5b6bab)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.675392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.752108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309d646336cc4d6ca71310a84f5b6bab', 'request_id': 'req-f0b6b134-ff66-46b5-a102-2c4174a09884'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.759739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309d646336cc4d6ca71310a84f5b6bab', 'request_id': 'req-f0b6b134-ff66-46b5-a102-2c4174a09884'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.771432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309d646336cc4d6ca71310a84f5b6bab', 'request_id': 'req-f0b6b134-ff66-46b5-a102-2c4174a09884'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.786137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] The token cache is being invalidate because project 309d646336cc4d6ca71310a84f5b6bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:41.791325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.791325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f0b6b134-ff66-46b5-a102-2c4174a09884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:41.791325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1285/2581] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:41 2022] DELETE /identity/v3/projects/309d646336cc4d6ca71310a84f5b6bab => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:41.796340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.796927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.796927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.827666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.829255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.929619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1297/2582] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:41.939999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.940326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.940602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.965810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.967815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.981141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.981728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1286/2583] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:41.983010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.985781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.996734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eca155-87de-427f-82e4-79abf411c2b2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.000395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788ca01-fef1-4ec1-b547-c3f9e2b827a7 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.001393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.001990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.002260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.002528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.003188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:42.003483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.005296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.005593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.006276 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.006612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.006946 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] PATH_INFO: `/v3/users/0639368c7c8f4c6a835a776272840004` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.008126 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0639368c7c8f4c6a835a776272840004)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.010120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.023398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1287/2584] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:42.028170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.038016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a3f8-0264-4214-ae5e-2859d34ab919 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.043968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.044566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.044807 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.045161 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.046312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.048572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.060479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0639368c7c8f4c6a835a776272840004'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.061167 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0639368c7c8f4c6a835a776272840004'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.071178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0639368c7c8f4c6a835a776272840004'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.083479 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1288/2585] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:42.087981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.100632 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0639368c7c8f4c6a835a776272840004'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.109789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0639368c7c8f4c6a835a776272840004'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.119044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1298/2586] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:41 2022] DELETE /identity/v3/users/0639368c7c8f4c6a835a776272840004 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.128817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.184604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bab052-002c-4da8-8c11-2d441d3780b7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.252140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.252752 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.253065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.253337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.254016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.255955 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.287086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1289/2587] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:42.288310 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.291675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.310408 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04410de-a3b9-4e4d-a4e4-2ace6cb4c9d7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.316014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.316660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.319990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.319990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.319990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.320819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.321382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.323414 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.332966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1299/2588] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.337667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.339726 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49493ab-87a6-4eaa-a6ec-4c99677ba5d5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.345277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.346544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.346849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.347764 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] PATH_INFO: `/v3/projects/d6c4a09e68874e1d96096345d0d8b65f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.349010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c4a09e68874e1d96096345d0d8b65f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.349849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb19d3-8631-405c-ad95-b24fbf442972 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.351089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.355811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.356423 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.356915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.357031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.357764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.359480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.371603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1300/2589] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.375970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.387299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64210-35bd-41fd-82a8-9934721d8293 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.394421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.395185 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.395949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.396294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] PATH_INFO: `/v3/projects/855aace34bed4964a209c1828647ecbf/users/ae95fefde08b4fa596362776208f63d0/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.407670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c4a09e68874e1d96096345d0d8b65f', 'request_id': 'req-7700d879-fda4-4618-9b5b-92af3c79c4d1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.412995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855aace34bed4964a209c1828647ecbf, user_id=ae95fefde08b4fa596362776208f63d0, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.416223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a46447-aac7-4a22-8459-39e394e420f3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.418120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c4a09e68874e1d96096345d0d8b65f', 'request_id': 'req-7700d879-fda4-4618-9b5b-92af3c79c4d1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.425494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c4a09e68874e1d96096345d0d8b65f', 'request_id': 'req-7700d879-fda4-4618-9b5b-92af3c79c4d1'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.432339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1301/2590] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/855aace34bed4964a209c1828647ecbf/users/ae95fefde08b4fa596362776208f63d0/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.442089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] The token cache is being invalidate because project d6c4a09e68874e1d96096345d0d8b65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:42.442089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.442348 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7700d879-fda4-4618-9b5b-92af3c79c4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:42.443887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1290/2591] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:42 2022] DELETE /identity/v3/projects/d6c4a09e68874e1d96096345d0d8b65f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:42.444694 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.445171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.445583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.449893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c534-fb9b-4a00-b199-50af773e9d36 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.450255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c534-fb9b-4a00-b199-50af773e9d36 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.450534 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256c534-fb9b-4a00-b199-50af773e9d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.476166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8256c534-fb9b-4a00-b199-50af773e9d36 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:42.478352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8256c534-fb9b-4a00-b199-50af773e9d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.490626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] MFA Rules not processed for user `ae95fefde08b4fa596362776208f63d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:42.491867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.497966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.531977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.550842 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1291/2592] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:42.562533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.562953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.563100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.575736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1302/2593] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:42.583582 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:42.584806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.587756 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.589157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.594445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1292/2594] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:42.598504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.608678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af523e67-b189-4063-b1e0-76f8605863b5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.613778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.614394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.614687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.614976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.615624 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:42.615925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.617650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.633155 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1293/2595] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:53:42.638258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.649829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8f34a-7735-4f65-94e1-5309bd1fb87b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.656243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.657958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.658253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.658530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.659635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.661224 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285523-a612-4326-901e-db347c4e8ed9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.663824 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.665610 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.666274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.666498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.666790 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.676427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.677917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.688468 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1303/2596] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:42.705691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1294/2597] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:42.707254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.719156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43f208-c5d7-4b0a-aec9-b895a71fceeb service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.794349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.794968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.795347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.795623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.796267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.798283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.829249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1304/2598] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:42.831091 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.843297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cf412-6031-42c8-bedc-ea4a3ae69d55 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.848237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.848939 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.849154 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.849607 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.850280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.852129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.865888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1295/2599] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.875219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.889707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a22f-117d-45c3-ad7e-5e7c541de48b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.897247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.897864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.898150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.898480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.900284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.902793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3ec97-21e1-42e7-aae1-2857b9a9adf3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.920878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1305/2600] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.931120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.942776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d9730-2011-4374-9d0f-b7699814b9dc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.950305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.951054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.951335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.951659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] PATH_INFO: `/v3/projects/e6fe80c5b0754884a61e174276113896/users/3e7dcbae5412480890e7e382d63e5b2a/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.969662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fe80c5b0754884a61e174276113896, user_id=3e7dcbae5412480890e7e382d63e5b2a, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.972977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.987528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1296/2601] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/e6fe80c5b0754884a61e174276113896/users/3e7dcbae5412480890e7e382d63e5b2a/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:42.998313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.998604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.998879 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:43.049488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] MFA Rules not processed for user `3e7dcbae5412480890e7e382d63e5b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:43.050821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:43.070547 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:43.133691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1306/2602] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:43.145650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:43.149694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:43.234892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37715bb-0f60-4f11-b9f6-3f5de696f4cc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:43.240862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:43.241669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:43.241944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:43.242210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:43.251398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:43.253082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:43.263190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1297/2603] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:45.794032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:45.795447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:45.859951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20ff4a-aa30-447c-badf-e2f5c2ce5117 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:45.864417 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:45.865068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:45.865344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:45.865613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] PATH_INFO: `/v3/users/ae95fefde08b4fa596362776208f63d0` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:45.866709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae95fefde08b4fa596362776208f63d0)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:45.869270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:45.917647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae95fefde08b4fa596362776208f63d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.918357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae95fefde08b4fa596362776208f63d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.927677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae95fefde08b4fa596362776208f63d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.941237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae95fefde08b4fa596362776208f63d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.955039 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:45.955483 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44771c05-ab9e-4ec7-92ed-a10e33050806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae95fefde08b4fa596362776208f63d0'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.961493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1307/2604] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:45 2022] DELETE /identity/v3/users/ae95fefde08b4fa596362776208f63d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:45.963309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0543e-78b5-41d5-bf00-d141effa51e1 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:45.965913 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:45.966191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:45.966458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:45.988579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:45.989802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.019541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:46.023789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:46.026925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.027975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.028588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.029132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] PATH_INFO: `/v3/users/3e7dcbae5412480890e7e382d63e5b2a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.030593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7dcbae5412480890e7e382d63e5b2a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.032545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.055181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1308/2605] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:46.065024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.066727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.095176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7dcbae5412480890e7e382d63e5b2a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.105743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7dcbae5412480890e7e382d63e5b2a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.106440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7dcbae5412480890e7e382d63e5b2a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.107106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7dcbae5412480890e7e382d63e5b2a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.129642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e547cd4c-ce98-4029-9297-23165cd1f010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7dcbae5412480890e7e382d63e5b2a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.136053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1298/2606] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:45 2022] DELETE /identity/v3/users/3e7dcbae5412480890e7e382d63e5b2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:46.140126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.140470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.140830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.154410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058a473-ff77-486d-8e17-3a4314014971 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.161540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.163255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.209043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.209957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.210338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.210671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.213094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.240075 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1299/2607] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:46.254317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.256253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.270522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa00e-662d-44c7-9a1a-03a4640a4176 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.275012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.275630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.275975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.276303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.286569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.288124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.299122 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1300/2608] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:46.307363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.309034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.319507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1309/2609] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:46.754313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.755814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.776480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0fe6-730f-447b-9d92-d6419442e79d service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.783234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.784009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.784262 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.784566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] PATH_INFO: `/v3/projects/e6fe80c5b0754884a61e174276113896` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.786198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fe80c5b0754884a61e174276113896)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.788545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.801714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.803205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.817743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428677-89f9-4d25-bf08-35c6ac23bbbe service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.823118 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.823930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.824203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.824473 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] PATH_INFO: `/v3/projects/855aace34bed4964a209c1828647ecbf` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.825654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=855aace34bed4964a209c1828647ecbf)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.827534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.856740 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fe80c5b0754884a61e174276113896', 'request_id': 'req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.863213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fe80c5b0754884a61e174276113896', 'request_id': 'req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.867190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:46.871500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fe80c5b0754884a61e174276113896', 'request_id': 'req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.873309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:46.882953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855aace34bed4964a209c1828647ecbf', 'request_id': 'req-ff7eb476-cb43-4981-b941-1b94d969b774'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.885206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] The token cache is being invalidate because project e6fe80c5b0754884a61e174276113896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:46.885563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.886275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-27c91fec-fed0-4fcf-bfb9-44ea5aef2bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.887794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1301/2610] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:46 2022] DELETE /identity/v3/projects/e6fe80c5b0754884a61e174276113896 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:46.890583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855aace34bed4964a209c1828647ecbf', 'request_id': 'req-ff7eb476-cb43-4981-b941-1b94d969b774'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.892564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bac05-b5f7-48be-88c5-06d26aed0ac8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.892880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bac05-b5f7-48be-88c5-06d26aed0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.893159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bac05-b5f7-48be-88c5-06d26aed0ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.897716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855aace34bed4964a209c1828647ecbf', 'request_id': 'req-ff7eb476-cb43-4981-b941-1b94d969b774'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.908639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] The token cache is being invalidate because project 855aace34bed4964a209c1828647ecbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:46.908956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.909604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ff7eb476-cb43-4981-b941-1b94d969b774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.911275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1310/2611] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:46 2022] DELETE /identity/v3/projects/855aace34bed4964a209c1828647ecbf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:46.913362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cb8bac05-b5f7-48be-88c5-06d26aed0ac8 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.914566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cb8bac05-b5f7-48be-88c5-06d26aed0ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.916469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac021bd-0dd4-406b-bda3-453382fb278a None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.917058 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac021bd-0dd4-406b-bda3-453382fb278a None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.917491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac021bd-0dd4-406b-bda3-453382fb278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.937603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-5ac021bd-0dd4-406b-bda3-453382fb278a None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.938791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5ac021bd-0dd4-406b-bda3-453382fb278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.976451 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1302/2612] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:46.985023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.985331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.985599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.999988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1311/2613] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:47.005574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:47.006784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.007615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.007895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.008162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.014828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1303/2614] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:47.018836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.029318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:47.030514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.030793 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd07f05-97a2-420a-bd9f-57baf6457fe6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.037762 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.038305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.038579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.038853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.039499 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:47.040368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.040511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1312/2615] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:47.042135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.045506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.054605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45371-0f90-4ff4-b00e-ba924630c44d None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.055304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1304/2616] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:53:47.060895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.061583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.061923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.062203 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.062857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:47.062993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.063156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.064740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.073765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7ad52-fb18-46f3-86fb-ea809cf50540 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.077329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1313/2617] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:47.081739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.081996 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.082603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.082880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.083150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.083780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.085729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.093110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455475b-fde9-4fe4-bafa-d00319ef4678 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.097801 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.098418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.098689 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.098954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.099569 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.101517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.115538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1305/2618] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:47.120307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.130334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1314/2619] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:47.134958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.187877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14922fcc-08b7-4e55-a9de-969e0141868b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.201615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0bbb9-4dec-4357-b324-e3aacb1ceb69 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.206355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.206952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.207223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.207490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.208119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.210053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.233635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1315/2620] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:47.237085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.237509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.247862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37474166-2925-4866-a3dc-dff95e91b06c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.248174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.249294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.249575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.249848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.250486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.252405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.252522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.253019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.253294 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.253562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.254192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.255747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.266254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1316/2621] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:47.270586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.280594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1306/2622] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:47.280794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.282230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.285991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00ad1b-6c09-4ab5-aff2-844ed1eb27e8 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.291839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.292045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376490cb-ab58-4d50-8d38-5f283f7dd64c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.292418 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.292937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.293278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.293921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.295519 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.296691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.297297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.297571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.297841 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.298524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.300131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.307732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1317/2623] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:47.313322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1307/2624] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:47.313460 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.314220 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.323102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5fc7-ff0a-4366-a174-25b950e023fa admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.324650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c95b-cceb-4a17-ba91-6f78314a82c5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.328739 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.329419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.329690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.329792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.329959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] PATH_INFO: `/v3/projects/f2023bd5d0134c8d9480b84e7e397db3/users/acc1085d3bcd4c8c93a6c897ef5c9164/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.330399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.330678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.330979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.331648 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.333297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.345305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1308/2625] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:47.345495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2023bd5d0134c8d9480b84e7e397db3, user_id=acc1085d3bcd4c8c93a6c897ef5c9164, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.348107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5e6b-10ed-4006-b779-6ac780b7eb68 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.349456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.360502 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfbe20-f39a-4ef7-86ca-d1694c825f62 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.364089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1318/2626] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:47 2022] PUT /identity/v3/projects/f2023bd5d0134c8d9480b84e7e397db3/users/acc1085d3bcd4c8c93a6c897ef5c9164/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:47.369350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.369643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.369905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.390243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:47.392057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.421696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.422353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.422647 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.422895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] PATH_INFO: `/v3/projects/836e2008bbb240a4b92763f41d73e989/users/65a21d7ef04546e391950561a6d34f06/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.437662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836e2008bbb240a4b92763f41d73e989, user_id=65a21d7ef04546e391950561a6d34f06, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.440356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e112af3-2eea-49c9-90fb-79979179d3f6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.453973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1319/2627] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:47.454244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1309/2628] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:47 2022] PUT /identity/v3/projects/836e2008bbb240a4b92763f41d73e989/users/65a21d7ef04546e391950561a6d34f06/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:47.465914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.466630 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.466919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.467191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.467373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.495926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] MFA Rules not processed for user `65a21d7ef04546e391950561a6d34f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:47.497186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.525371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5c11-cc86-4373-b76c-ca0490d226c1 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.564232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1310/2629] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:47.576494 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.577993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.580082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.580680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.580983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.581250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.612696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.621766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.644456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.645910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.655325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793bd8b-488c-4c70-9873-83a7f2799c47 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.656435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1320/2630] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:47.661043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.661643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.661919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.662587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.670279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.671855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4e95e-85da-49c9-b9aa-5530221375d4 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.681565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1311/2631] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:47.930034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.940285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc27e1-3f21-4d86-b269-b1800fae511b service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.945642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.947341 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.947620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.947878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] PATH_INFO: `/v3/users/65a21d7ef04546e391950561a6d34f06` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.951876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a21d7ef04546e391950561a6d34f06)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.953840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:48.006130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a21d7ef04546e391950561a6d34f06'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.006864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a21d7ef04546e391950561a6d34f06'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.015528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a21d7ef04546e391950561a6d34f06'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.028288 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a21d7ef04546e391950561a6d34f06'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.040232 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a21d7ef04546e391950561a6d34f06'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.047934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1321/2632] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:47 2022] DELETE /identity/v3/users/65a21d7ef04546e391950561a6d34f06 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:48.052215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffad9b-fffa-4371-b274-0b713424490b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.052698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffad9b-fffa-4371-b274-0b713424490b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.052819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffad9b-fffa-4371-b274-0b713424490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.074727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-98ffad9b-fffa-4371-b274-0b713424490b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:48.076026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-98ffad9b-fffa-4371-b274-0b713424490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.153586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1312/2633] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:48.165064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:48.167802 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.239148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e7e6-4f07-4b32-910f-7bfe5686c62d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:48.243380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:48.244335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.244608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.244910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.255433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:48.256906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:48.269419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1322/2634] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:48.444795 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.445845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.447088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.493926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] MFA Rules not processed for user `acc1085d3bcd4c8c93a6c897ef5c9164`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:48.495916 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.591614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1313/2635] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:48.607624 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:48.609163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.695724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928781-f98b-476d-a85b-c0c2460595b7 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:48.700639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:48.701328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.701858 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.702127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.708714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:48.714155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:48.716298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c7bcc-0ef9-4c23-918b-f67e59590bdf service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:48.731196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1323/2636] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:48.809354 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:48.812681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.828054 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880c682-4be3-42f3-a3c7-0256035a2435 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:48.839865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:48.840878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.841312 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.841804 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] PATH_INFO: `/v3/projects/836e2008bbb240a4b92763f41d73e989` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.843697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] RBAC: Authorizing `identity:delete_project(project_id=836e2008bbb240a4b92763f41d73e989)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:48.847236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:48.925723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:48.933833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836e2008bbb240a4b92763f41d73e989', 'request_id': 'req-e4388e29-0e2b-4ae7-8915-924bec45061e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.941364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836e2008bbb240a4b92763f41d73e989', 'request_id': 'req-e4388e29-0e2b-4ae7-8915-924bec45061e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.955504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836e2008bbb240a4b92763f41d73e989', 'request_id': 'req-e4388e29-0e2b-4ae7-8915-924bec45061e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.970986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] The token cache is being invalidate because project 836e2008bbb240a4b92763f41d73e989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:48.971398 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.972967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-e4388e29-0e2b-4ae7-8915-924bec45061e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:48.981548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.982105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1314/2637] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:48 2022] DELETE /identity/v3/projects/836e2008bbb240a4b92763f41d73e989 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:48.982291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.982291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.017849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:49.020862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.154359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1324/2638] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:49.162340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.162860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.162968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.194149 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:49.195524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.211273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1315/2639] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:49.216463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.226904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d3a8-d006-4b99-9929-1434e1774ec7 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.235390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.236256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.236528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.236897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.237551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:49.237852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.246525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.281633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1325/2640] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:53:49.287058 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.302260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6363a2-33d4-4670-af55-4e3b768fb2aa None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.308705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.309353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.309626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.309894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.310529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.313586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.363786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1316/2641] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:49.365363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.382430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5655b-8d47-45f6-994d-6d2c48fcd542 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.453862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.454659 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.455084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.455456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.456375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.462363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.490331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1326/2642] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:49.495310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.511836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe0afa-bccb-4c2a-844b-86201175422c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.517968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.518633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.519403 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.520099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.521185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.523662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.536207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1317/2643] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:49.541006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.551481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328ddb1-095b-4f5c-9017-43e85dca3a8a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.556960 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.557578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.557884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.558153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.558805 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.560413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a765-f872-4243-8648-8feb6681ad9e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.572004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1327/2644] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:49.576402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.587465 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578a1f5-1559-4d00-af99-cc4424758ae1 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.592412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.593120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.593404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.593678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] PATH_INFO: `/v3/projects/333fe2c5abf9444ba722524064187939/users/53d0598c6e9547c39f2c3467ecb760a2/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.610603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=333fe2c5abf9444ba722524064187939, user_id=53d0598c6e9547c39f2c3467ecb760a2, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.613318 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.627819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1318/2645] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:49 2022] PUT /identity/v3/projects/333fe2c5abf9444ba722524064187939/users/53d0598c6e9547c39f2c3467ecb760a2/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:49.638838 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.639121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.639391 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.668323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] MFA Rules not processed for user `53d0598c6e9547c39f2c3467ecb760a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:49.669580 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.718990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:49.744977 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1328/2646] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:49.746140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.826860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeee51-e328-4814-9028-90ffad469d82 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.832849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.833474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.833780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.834050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.834691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.836632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.866826 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1319/2647] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:49.871623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.889511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c76139-657e-4691-94f6-98dbee875cdd None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.966593 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.967187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.967479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.967744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.968388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.970347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.992618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1329/2648] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:49.997369 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.008179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac875521-782c-4a6d-aa46-2f59cc72bb91 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.014297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.014903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.015188 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.015462 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.016100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.017744 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.030547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1320/2649] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:50.034810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.045509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fe49c-96c7-4061-9a7f-71f5c8eb5e1e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.050433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.051091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.051375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.051655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] PATH_INFO: `/v3/projects/5885835eb4754481a4784eb074e1542a/users/ac11fb7de3eb4e9fb078b9a5bd1cf006/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.070191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5885835eb4754481a4784eb074e1542a, user_id=ac11fb7de3eb4e9fb078b9a5bd1cf006, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.073529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.089599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1330/2650] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:50 2022] PUT /identity/v3/projects/5885835eb4754481a4784eb074e1542a/users/ac11fb7de3eb4e9fb078b9a5bd1cf006/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:50.090720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.101911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051adba-a3ba-4c18-bd60-1e3b0faa5ebc admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.140381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:50.185714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.186476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.186930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.187364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.188119 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.189935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7b477-dbd2-45e3-9d09-e3783649f666 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.210935 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1321/2651] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:50.219100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.220421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.220709 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.221080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.231994 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d45ce-66ef-42a3-8572-f5a0546d527e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.240622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.241358 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.245076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.245465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] PATH_INFO: `/v3/projects/5885835eb4754481a4784eb074e1542a/users/ac11fb7de3eb4e9fb078b9a5bd1cf006/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.246907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] MFA Rules not processed for user `acc1085d3bcd4c8c93a6c897ef5c9164`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:50.247786 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5885835eb4754481a4784eb074e1542a, user_id=ac11fb7de3eb4e9fb078b9a5bd1cf006, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.248650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.253528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfb8d-b81d-4b3b-818d-de3bdfeb67bb admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.266031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1331/2652] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:50 2022] PUT /identity/v3/projects/5885835eb4754481a4784eb074e1542a/users/ac11fb7de3eb4e9fb078b9a5bd1cf006/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:50.279515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.280715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.281238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.326548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] MFA Rules not processed for user `ac11fb7de3eb4e9fb078b9a5bd1cf006`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:50.328056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.338012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1322/2653] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:50.473998 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1332/2654] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:50.483268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.485862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.575981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ade0b-9615-46e8-9649-1009cccc3d54 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.651510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.652150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.652426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.652698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.664424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.666627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1b412-5e98-42aa-8248-eb8e787466f3 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.678784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1323/2655] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:51.315431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.359880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:51.413525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3588b3d-e59b-43e0-9c93-061d03f59a32 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.419505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.420158 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.420433 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.420702 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] PATH_INFO: `/v3/users/53d0598c6e9547c39f2c3467ecb760a2` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.422000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d0598c6e9547c39f2c3467ecb760a2)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.423909 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.488597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d0598c6e9547c39f2c3467ecb760a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.489001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d0598c6e9547c39f2c3467ecb760a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.497575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d0598c6e9547c39f2c3467ecb760a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.512219 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d0598c6e9547c39f2c3467ecb760a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.520944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d0598c6e9547c39f2c3467ecb760a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.530038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1333/2656] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:51 2022] DELETE /identity/v3/users/53d0598c6e9547c39f2c3467ecb760a2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:51.534617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.535235 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.535380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.557292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:51.558518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.592710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:51.637298 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1324/2657] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:51.648008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.650400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.719401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9230899-3629-432d-9ea5-d3e7c179ce08 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.723996 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.724907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.725277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.725544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.737419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.739781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.751308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1334/2658] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:52.053604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.054999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:52.068267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05b27d-eba7-4242-b93c-a68919636f9d None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.073671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.074326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.074602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.074875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] PATH_INFO: `/v3/projects/333fe2c5abf9444ba722524064187939` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.075993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333fe2c5abf9444ba722524064187939)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.077952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.129840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333fe2c5abf9444ba722524064187939', 'request_id': 'req-9d9f0b5b-af89-44a3-a6c2-578705d14302'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.136590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333fe2c5abf9444ba722524064187939', 'request_id': 'req-9d9f0b5b-af89-44a3-a6c2-578705d14302'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.143953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333fe2c5abf9444ba722524064187939', 'request_id': 'req-9d9f0b5b-af89-44a3-a6c2-578705d14302'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.154851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] The token cache is being invalidate because project 333fe2c5abf9444ba722524064187939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:52.155134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.155748 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.157267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1325/2659] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:52 2022] DELETE /identity/v3/projects/333fe2c5abf9444ba722524064187939 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:52.161367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.171234 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99bc0d-232b-4ed1-a187-09d9a68cbf62 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.215496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:52.229463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.230467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.230622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.230852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] PATH_INFO: `/v3/users/ac11fb7de3eb4e9fb078b9a5bd1cf006` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.232000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac11fb7de3eb4e9fb078b9a5bd1cf006)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.234141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.290816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac11fb7de3eb4e9fb078b9a5bd1cf006'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.291667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac11fb7de3eb4e9fb078b9a5bd1cf006'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.299956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac11fb7de3eb4e9fb078b9a5bd1cf006'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.317971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac11fb7de3eb4e9fb078b9a5bd1cf006'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.328174 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-c7b15176-7ce3-4600-af02-a77ea79824ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac11fb7de3eb4e9fb078b9a5bd1cf006'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.334717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1335/2660] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:52 2022] DELETE /identity/v3/users/ac11fb7de3eb4e9fb078b9a5bd1cf006 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:52.755816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.759163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:52.778660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0b5b-af89-44a3-a6c2-578705d14302 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.854579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.855215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.855491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.855759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] PATH_INFO: `/v3/projects/5885835eb4754481a4784eb074e1542a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.856914 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5885835eb4754481a4784eb074e1542a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.858897 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.910966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5885835eb4754481a4784eb074e1542a', 'request_id': 'req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.918688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5885835eb4754481a4784eb074e1542a', 'request_id': 'req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.923521 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:52.927191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5885835eb4754481a4784eb074e1542a', 'request_id': 'req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.940954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] The token cache is being invalidate because project 5885835eb4754481a4784eb074e1542a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:52.941512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.942185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-5a63effc-82c2-4c0d-be7d-ec4d45a5c4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:52.943673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1326/2661] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:52 2022] DELETE /identity/v3/projects/5885835eb4754481a4784eb074e1542a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:52.949238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.949609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.949917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.971395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:52.972648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.037197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1336/2662] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:53.045628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.045981 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.046410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.066755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:53.068042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.077108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1327/2663] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:53.081533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.092626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26d8f-d694-4bf0-a02c-4cf374c6b275 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.105283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.106008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.106213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.106459 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.107266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:53.107599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.109388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.122262 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1337/2664] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:53.127730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.137549 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae01d26-2f19-4263-a179-07e5d5c7fc0e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.143285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.144330 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.144714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.145176 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.145895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.147922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.183341 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1328/2665] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.187859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.200686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923cd09-7db5-4956-9372-7da0b7f8ab94 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.258709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:53.269396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.270353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.270863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.271251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.272115 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.275129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.299573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1338/2666] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.305258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.316213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392ef19-2147-48db-80a7-f25cc45f1729 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.321718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.322389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.322686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.322954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.323600 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.325279 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.340855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1329/2667] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.342494 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.359812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509be25-aa0b-4c6d-bb28-3a378dddd099 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.367266 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.369316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.369760 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.370197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.371271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.373197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bfbcc-fe5d-476c-9631-f64dd75b50d3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.388271 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1339/2668] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.390074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.402688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32f83f-647f-4668-9c3c-c143f3ffa2a2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.407640 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.408334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.409317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.409317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] PATH_INFO: `/v3/projects/95715e29b99d4a28b7fdfb3011b068b0/users/b017e3ed9b9742c0b67575caef8f1bb6/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.425849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95715e29b99d4a28b7fdfb3011b068b0, user_id=b017e3ed9b9742c0b67575caef8f1bb6, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.428533 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.444202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1330/2669] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/95715e29b99d4a28b7fdfb3011b068b0/users/b017e3ed9b9742c0b67575caef8f1bb6/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:53.455983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.456293 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.456540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.491943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] MFA Rules not processed for user `b017e3ed9b9742c0b67575caef8f1bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:53.493987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.575475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1340/2670] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:53.579634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.666072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c574a-f0f1-483e-8226-2ccd776d39b4 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.675045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.676751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.676751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.676751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.678003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.683227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.731187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1331/2671] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.735947 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.755475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1869c0-bd72-42a7-87d4-a2eaf416f524 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.790610 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.793272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.847647 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.848675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.849251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.849734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.850323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.852684 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.876352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0714-b023-46c7-bca6-e2c8dcccd963 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.889406 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1341/2672] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.893247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.896139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.896950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.897305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.897698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.900008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.912206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18f00-3ffc-4569-8120-39510ec3dab0 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.918438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.919377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.919667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.919939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.920587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.922322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.923550 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.927584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.936984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1342/2673] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.939028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.953955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3592cb-6c13-400d-901d-8de6e6182982 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.954487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1332/2674] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:53.967032 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.968145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.968620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.969142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] PATH_INFO: `/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1/users/291c61772b71488f8a650e386518e605/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.997549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3f153fcb3b4ba4b3cce20e404f10d1, user_id=291c61772b71488f8a650e386518e605, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.002324 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.026449 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1343/2675] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1/users/291c61772b71488f8a650e386518e605/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:54.031123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.041424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a0717-ad6c-492f-921e-b9192e6791dc service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.053353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:54.121004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.121568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.121894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.122162 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.122874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.124587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cff120-2fce-4536-a502-8b198526b740 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.139382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1333/2676] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:54.140664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.154846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f67451-46ec-4902-9ee7-b6bef3155982 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.159690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.160638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.161327 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.161667 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] PATH_INFO: `/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1/users/291c61772b71488f8a650e386518e605/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.163780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3f153fcb3b4ba4b3cce20e404f10d1, user_id=291c61772b71488f8a650e386518e605, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.167134 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.181088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1344/2677] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:54 2022] PUT /identity/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1/users/291c61772b71488f8a650e386518e605/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:54.191775 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.192059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.192453 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.229340 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] MFA Rules not processed for user `291c61772b71488f8a650e386518e605`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:54.231092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.333717 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1334/2678] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:54.346351 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.348277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.355532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:54.428259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb090e8-77cf-487f-92e0-7d4e49d8d54d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.432908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.433685 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.433967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.434227 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.444633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.446206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.456645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1345/2679] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:54.536669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.618078 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.635123 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0049ddb-18ba-4b00-92a3-4c2811333388 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.640309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.641253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.641754 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.642210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] PATH_INFO: `/v3/users/b017e3ed9b9742c0b67575caef8f1bb6` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.644485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b017e3ed9b9742c0b67575caef8f1bb6)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.646571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.690452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f65d1e-3e8c-4211-bb0b-b9f7bc238d86 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.695532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.696831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.697320 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.697691 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.700257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.702420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:54.716227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b017e3ed9b9742c0b67575caef8f1bb6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:54.728441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b017e3ed9b9742c0b67575caef8f1bb6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:54.729290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b017e3ed9b9742c0b67575caef8f1bb6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:54.730316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b017e3ed9b9742c0b67575caef8f1bb6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:54.747731 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-29a4ea43-dded-4163-a0dc-87f2d7bd5752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b017e3ed9b9742c0b67575caef8f1bb6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:54.763786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1335/2680] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:54 2022] DELETE /identity/v3/users/b017e3ed9b9742c0b67575caef8f1bb6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:54.768500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.768801 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.769349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.796043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:54.797489 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.808863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.811634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.828550 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1346/2681] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:54.866036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1336/2682] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:54.876953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.879832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.889383 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efea267-4e92-4c27-8dda-e54af03a9c91 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.963120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:54.970952 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.971762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.972281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.972627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.986609 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.988050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.999420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1347/2683] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:55.312702 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:55.314266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:55.327728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f0642-afba-427a-93ed-b5f8a72c478b None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:55.334034 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:55.334963 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:55.335311 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:55.335667 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] PATH_INFO: `/v3/projects/95715e29b99d4a28b7fdfb3011b068b0` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:55.338038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95715e29b99d4a28b7fdfb3011b068b0)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:55.340391 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:55.390833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95715e29b99d4a28b7fdfb3011b068b0', 'request_id': 'req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.397759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95715e29b99d4a28b7fdfb3011b068b0', 'request_id': 'req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.406461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95715e29b99d4a28b7fdfb3011b068b0', 'request_id': 'req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.416859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] The token cache is being invalidate because project 95715e29b99d4a28b7fdfb3011b068b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:55.417536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.417854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.419678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1337/2684] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:55 2022] DELETE /identity/v3/projects/95715e29b99d4a28b7fdfb3011b068b0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:55.424424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:55.434985 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbca9-2271-4f6e-89ec-f3977e6e6172 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:55.495202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:55.495859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:55.496135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:55.496411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] PATH_INFO: `/v3/users/291c61772b71488f8a650e386518e605` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:55.497643 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=291c61772b71488f8a650e386518e605)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:55.499686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:55.550291 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291c61772b71488f8a650e386518e605'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.551107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291c61772b71488f8a650e386518e605'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.561387 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291c61772b71488f8a650e386518e605'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.574505 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291c61772b71488f8a650e386518e605'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.582522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291c61772b71488f8a650e386518e605'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:55.588959 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1348/2685] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:55 2022] DELETE /identity/v3/users/291c61772b71488f8a650e386518e605 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:55.943587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:55.945224 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:55.960333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e26b7f-9b0e-4099-98d0-93bf5fa9f347 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.021535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:56.052593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.053337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.053614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.053888 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] PATH_INFO: `/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.055854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3f153fcb3b4ba4b3cce20e404f10d1)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.058103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.131725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.133925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:56.143112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3f153fcb3b4ba4b3cce20e404f10d1', 'request_id': 'req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:56.155673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3f153fcb3b4ba4b3cce20e404f10d1', 'request_id': 'req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:56.168944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3f153fcb3b4ba4b3cce20e404f10d1', 'request_id': 'req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:56.183296 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] The token cache is being invalidate because project 4f3f153fcb3b4ba4b3cce20e404f10d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:56.183638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:56.184236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-ca2e4788-0b19-45fa-9c68-410ebe5f0cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:56.188796 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1338/2686] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:55 2022] DELETE /identity/v3/projects/4f3f153fcb3b4ba4b3cce20e404f10d1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:56.191187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4d19-6d00-468c-aabb-8f8a4e42aadf None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.191469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4d19-6d00-468c-aabb-8f8a4e42aadf None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.191739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4d19-6d00-468c-aabb-8f8a4e42aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.221007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ed5d4d19-6d00-468c-aabb-8f8a4e42aadf None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:56.222134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ed5d4d19-6d00-468c-aabb-8f8a4e42aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:56.225159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742292b-61aa-4ff3-b3fe-8bcf782ebb7b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.265944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:56.304067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616bcd-611f-4780-a474-147817451423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.305063 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616bcd-611f-4780-a474-147817451423 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.305601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616bcd-611f-4780-a474-147817451423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.306346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616bcd-611f-4780-a474-147817451423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.308367 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-88616bcd-611f-4780-a474-147817451423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:56.318373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1339/2687] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:56.320429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.321374 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.321743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.349066 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:56.350541 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:56.360816 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1340/2688] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:56.365475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.376392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038441fd-ce7b-4431-a263-46879fcb7e44 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.381864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.382590 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.382962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.383941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.384787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:56.385208 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.386944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.406392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1341/2689] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:56.407396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616bcd-611f-4780-a474-147817451423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.410390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616bcd-611f-4780-a474-147817451423 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.426227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.439619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1349/2690] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:56.442869 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64b2b6-6321-4e5f-80a7-a4d1268ff5e0 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.448827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.450193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.450603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.450987 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.451714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.453966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.512428 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1342/2691] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:56.513577 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616bcd-611f-4780-a474-147817451423 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.525335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616bcd-611f-4780-a474-147817451423 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.605697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.606309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.606584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.606849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.607479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.609419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.631931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1350/2692] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:56.636967 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.647966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e7fbf-fda3-43a7-8966-a989d31cd568 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.653131 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.653727 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.654003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.654270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.654910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.656510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.667765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1343/2693] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:56.671966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.683457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbf85a-fc7f-4640-aa65-d8b163717f8c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.688171 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.688798 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.689070 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.689339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.689975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.691561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9dfcd-fb2c-4308-b25d-e9471b145622 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.702709 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1351/2694] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:56.707029 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.717915 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33c52-db29-496b-8441-587001382d51 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.722668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.723274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.723556 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.723832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] PATH_INFO: `/v3/projects/388c4d60c1784b8a8c73afd4ac0bc83d/users/42380e38caba4a2b9a1550da82aff32a/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.735277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:56.740329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=388c4d60c1784b8a8c73afd4ac0bc83d, user_id=42380e38caba4a2b9a1550da82aff32a, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.744148 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:56.759339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1344/2695] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:56 2022] PUT /identity/v3/projects/388c4d60c1784b8a8c73afd4ac0bc83d/users/42380e38caba4a2b9a1550da82aff32a/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:56.771501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.771501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.771501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.807363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] MFA Rules not processed for user `42380e38caba4a2b9a1550da82aff32a`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:56.808618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:56.849069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:56.889289 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1352/2696] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:56.893663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.969858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cb0b2-dedd-49c4-a199-7b7d20a5ce8b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.974718 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.975255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.975526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.975791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.976433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.979102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.006484 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1345/2697] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:56 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:57.010716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.023109 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0fc8-cc57-49cd-b049-5b63c59335cf None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.087675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.088301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.088693 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.089006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.089940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.091890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.121356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1353/2698] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:57 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:57.125113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.136417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5fc08-491c-4cc0-b572-b831d4c5d392 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.152678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.152678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.152678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.152678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.158065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.158065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.173926 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1346/2699] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:57.177968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.193017 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622e3d-364e-4efe-b20b-731ab561bd99 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.199478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.200290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.200578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.200892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] PATH_INFO: `/v3/projects/de3ae4e96f89454cb154040eef5cc857/users/980fa2880f0842869dfe1ce3f6c5f63f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.246999 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3ae4e96f89454cb154040eef5cc857, user_id=980fa2880f0842869dfe1ce3f6c5f63f, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.251375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.276866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1354/2700] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:57 2022] PUT /identity/v3/projects/de3ae4e96f89454cb154040eef5cc857/users/980fa2880f0842869dfe1ce3f6c5f63f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:57.278280 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.293441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a006b-c6cd-4dfb-a4ed-035a3cd56aba admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.371096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.372347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.372681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.373182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.373998 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.375849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe02d8-ba8b-4ea7-9f75-8e79026c4aa9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.389654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1347/2701] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:57.393931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.407444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb42a5-9537-436b-8425-fb033381b3cc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.413368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.418445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.422187 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.422515 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] PATH_INFO: `/v3/projects/de3ae4e96f89454cb154040eef5cc857/users/980fa2880f0842869dfe1ce3f6c5f63f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.427303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3ae4e96f89454cb154040eef5cc857, user_id=980fa2880f0842869dfe1ce3f6c5f63f, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.431991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.455347 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1355/2702] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:57 2022] PUT /identity/v3/projects/de3ae4e96f89454cb154040eef5cc857/users/980fa2880f0842869dfe1ce3f6c5f63f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:57.456026 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.456402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.456780 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.493319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] MFA Rules not processed for user `980fa2880f0842869dfe1ce3f6c5f63f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:57.494469 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:57.559497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:57.599776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1348/2703] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:57.620486 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.622475 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:57.734914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c41a80-9646-46e7-8be0-5d9ebcad992a admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.747948 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.748723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.749037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.749304 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.762814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.764575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.791553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1356/2704] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:58.156847 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.158353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.223489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.233655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52998fe6-0d94-4531-9bb0-22f2883a5910 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.235427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad52e-9a59-43ac-9043-62ab22aa4391 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.238766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980fa2880f0842869dfe1ce3f6c5f63f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de3ae4e96f89454cb154040eef5cc857', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.239442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.239792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.240131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.240872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:58.241240 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.243590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.245198 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.245860 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.246143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.246431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] PATH_INFO: `/v3/users/476c96600c524cc293bc0e0a65ee8cb5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.257084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1357/2705] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:53:58.261918 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.263051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=476c96600c524cc293bc0e0a65ee8cb5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.265903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.273001 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f5aff-3396-4334-bcba-ff0f6f27cfcc tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.279427 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980fa2880f0842869dfe1ce3f6c5f63f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de3ae4e96f89454cb154040eef5cc857', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.280048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.280331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.280606 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.281298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.283299 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.301906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:58.317639 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1358/2706] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:58.323216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.328632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476c96600c524cc293bc0e0a65ee8cb5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.340509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476c96600c524cc293bc0e0a65ee8cb5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.341204 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476c96600c524cc293bc0e0a65ee8cb5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.341825 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476c96600c524cc293bc0e0a65ee8cb5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.356190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476c96600c524cc293bc0e0a65ee8cb5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.369566 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1349/2707] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:58 2022] DELETE /identity/v3/users/476c96600c524cc293bc0e0a65ee8cb5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:58.409581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ace3b-9fb9-4529-96ce-986ecf80c224 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.480043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980fa2880f0842869dfe1ce3f6c5f63f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de3ae4e96f89454cb154040eef5cc857', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.480706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.480939 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.481216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.481874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:58.482183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.483800 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.496930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1359/2708] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:58.540832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.542290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.557277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435109-b647-49cf-9a03-bc0ef9a21f7e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.560573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.562430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.575360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '980fa2880f0842869dfe1ce3f6c5f63f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de3ae4e96f89454cb154040eef5cc857', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.575360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.575360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.576103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] PATH_INFO: `/v3/projects/535320e23bac42728f74f33fa4a7aef1` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.576103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorizing `identity:delete_project(project_id=535320e23bac42728f74f33fa4a7aef1)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.576103 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.634376 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:58.636173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535320e23bac42728f74f33fa4a7aef1', 'request_id': 'req-2608cef8-9800-4272-a8fc-3c568de83881'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.645407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535320e23bac42728f74f33fa4a7aef1', 'request_id': 'req-2608cef8-9800-4272-a8fc-3c568de83881'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.650419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c67d-61f8-43e6-ac59-86d37bad4b5a tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.654643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535320e23bac42728f74f33fa4a7aef1', 'request_id': 'req-2608cef8-9800-4272-a8fc-3c568de83881'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.666653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] The token cache is being invalidate because project 535320e23bac42728f74f33fa4a7aef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:58.667031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.667768 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2608cef8-9800-4272-a8fc-3c568de83881 tempest-VolumeQuotaClassesTest-2146366300 tempest-VolumeQuotaClassesTest-2146366300-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.669384 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1350/2709] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:58 2022] DELETE /identity/v3/projects/535320e23bac42728f74f33fa4a7aef1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:58.697282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:58.713920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.714664 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.714936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.715204 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] PATH_INFO: `/v3/projects/5674689db71e4d8292aadfea378d91f3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.728744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5674689db71e4d8292aadfea378d91f3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.731511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.783272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5674689db71e4d8292aadfea378d91f3', 'request_id': 'req-ed692c30-4afc-4435-908c-b864259b8ce9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.791062 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5674689db71e4d8292aadfea378d91f3', 'request_id': 'req-ed692c30-4afc-4435-908c-b864259b8ce9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.806869 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5674689db71e4d8292aadfea378d91f3', 'request_id': 'req-ed692c30-4afc-4435-908c-b864259b8ce9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.818445 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] The token cache is being invalidate because project 5674689db71e4d8292aadfea378d91f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:58.818845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.819516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.821520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1360/2710] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:58 2022] DELETE /identity/v3/projects/5674689db71e4d8292aadfea378d91f3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:58.827242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ef2c-2a17-4686-8928-238fea9d14a5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.827571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ef2c-2a17-4686-8928-238fea9d14a5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.827878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792ef2c-2a17-4686-8928-238fea9d14a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.852688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-3792ef2c-2a17-4686-8928-238fea9d14a5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:58.854090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-3792ef2c-2a17-4686-8928-238fea9d14a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.891628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.892544 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.930719 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1351/2711] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:58.940701 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.941084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.941429 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.963941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:58.965193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.971439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed692c30-4afc-4435-908c-b864259b8ce9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.973571 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1352/2712] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:58.976518 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.977920 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.978259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.978375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.978645 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] PATH_INFO: `/v3/users/42380e38caba4a2b9a1550da82aff32a` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.979868 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] RBAC: Authorizing `identity:delete_user(user_id=42380e38caba4a2b9a1550da82aff32a)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.981880 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.989767 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d30bb-5e70-46ac-b661-be3804b8c2f6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.994509 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.995708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.995708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.995708 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.996519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:58.996928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.998705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.011256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1353/2713] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:59.015417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.026662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a2f5-dd4d-4678-97b7-9d0e79a84400 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.034547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.035132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.035559 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.035956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.037536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.040820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.046536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42380e38caba4a2b9a1550da82aff32a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.047487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42380e38caba4a2b9a1550da82aff32a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.059080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42380e38caba4a2b9a1550da82aff32a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.071815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.074884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42380e38caba4a2b9a1550da82aff32a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.078771 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1354/2714] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:59.083018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-250ec64c-cbb1-4214-9a9a-d6c5d5a2a4df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42380e38caba4a2b9a1550da82aff32a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.085062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.087362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.092202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1361/2715] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:58 2022] DELETE /identity/v3/users/42380e38caba4a2b9a1550da82aff32a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:59.096565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.097041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.097566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.117934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:59.119338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.171126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2728b5-e7cf-4fe1-868b-69073f5d2f51 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.197573 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1362/2716] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:59.210005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.212769 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.226778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.253622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.254244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.254524 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.254794 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.255434 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.257688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.283240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1355/2717] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:59.287907 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.292493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a03bfd-4ebc-4fd0-abea-bf4e40b2822c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.297384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.298201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.298553 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.298886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.300203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29c3b9-2362-4da4-a88c-99f342ad9fa8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.306604 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.307523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.307899 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.308274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.309047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.310823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.311085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.312597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.327048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1363/2718] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:59.331035 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1356/2719] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:59.334817 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.346668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a24a1-c2b7-46c8-9890-a7afe1344ebe service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.352067 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.352785 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.353130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.353474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.354478 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.356042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3e44b-06d4-47e0-bd6f-511850f425ca admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.370065 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1364/2720] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:59.372576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.384010 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c375c-d9c8-4fb5-9e09-c4cd868f7b3d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.396966 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.397646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.397925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.398200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] PATH_INFO: `/v3/projects/5208addfaca543bca48d8c446581245e/users/d156d1fae6934fd1a2af5ac00b033c36/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.419132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5208addfaca543bca48d8c446581245e, user_id=d156d1fae6934fd1a2af5ac00b033c36, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.422153 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.439574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1357/2721] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:59 2022] PUT /identity/v3/projects/5208addfaca543bca48d8c446581245e/users/d156d1fae6934fd1a2af5ac00b033c36/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:59.451962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.452247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.452539 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.496199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] MFA Rules not processed for user `d156d1fae6934fd1a2af5ac00b033c36`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:59.497565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.574455 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1365/2722] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:59.585186 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.586960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.645646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.647268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.659671 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcb840-277f-4b89-a0d0-3e6deeb1cdec admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.663937 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.666314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.667301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.667759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.668197 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.682264 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.683950 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.694156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1358/2723] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:59.736740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b063-1876-4a14-8d6c-d5d7b00cd072 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.741958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.743469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.743812 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.744173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] PATH_INFO: `/v3/projects/388c4d60c1784b8a8c73afd4ac0bc83d` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.745561 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388c4d60c1784b8a8c73afd4ac0bc83d)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.747540 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.807861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388c4d60c1784b8a8c73afd4ac0bc83d', 'request_id': 'req-972b514b-48c7-4a7a-87d8-cce9658f04b2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.814270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388c4d60c1784b8a8c73afd4ac0bc83d', 'request_id': 'req-972b514b-48c7-4a7a-87d8-cce9658f04b2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.822594 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388c4d60c1784b8a8c73afd4ac0bc83d', 'request_id': 'req-972b514b-48c7-4a7a-87d8-cce9658f04b2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.833844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] The token cache is being invalidate because project 388c4d60c1784b8a8c73afd4ac0bc83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:59.834129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.834992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.837050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1366/2724] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:59 2022] DELETE /identity/v3/projects/388c4d60c1784b8a8c73afd4ac0bc83d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:59.841009 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.852569 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690f6e7-3858-4b71-8bce-9b09352c70aa service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.918968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.919662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.919945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.920300 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] PATH_INFO: `/v3/users/980fa2880f0842869dfe1ce3f6c5f63f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.921503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=980fa2880f0842869dfe1ce3f6c5f63f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.923562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.973454 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.981930 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980fa2880f0842869dfe1ce3f6c5f63f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.994820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980fa2880f0842869dfe1ce3f6c5f63f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.997177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980fa2880f0842869dfe1ce3f6c5f63f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:59.998022 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980fa2880f0842869dfe1ce3f6c5f63f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.014531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-768c496b-25d5-44c9-bbac-c057dd284bf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980fa2880f0842869dfe1ce3f6c5f63f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.033207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1359/2725] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:59 2022] DELETE /identity/v3/users/980fa2880f0842869dfe1ce3f6c5f63f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:00.356810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.358344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:00.377010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b514b-48c7-4a7a-87d8-cce9658f04b2 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.438254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.438890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.439190 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.439463 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] PATH_INFO: `/v3/projects/de3ae4e96f89454cb154040eef5cc857` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.440701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3ae4e96f89454cb154040eef5cc857)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.442633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.490233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:00.498137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3ae4e96f89454cb154040eef5cc857', 'request_id': 'req-80269751-25a7-47b5-8586-a67f76ac305c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.505581 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3ae4e96f89454cb154040eef5cc857', 'request_id': 'req-80269751-25a7-47b5-8586-a67f76ac305c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.513261 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3ae4e96f89454cb154040eef5cc857', 'request_id': 'req-80269751-25a7-47b5-8586-a67f76ac305c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.524186 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] The token cache is being invalidate because project de3ae4e96f89454cb154040eef5cc857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:00.524456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.525133 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-80269751-25a7-47b5-8586-a67f76ac305c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:00.526622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1367/2726] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:00 2022] DELETE /identity/v3/projects/de3ae4e96f89454cb154040eef5cc857 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:00.533044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.533563 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.533714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.553863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:00.555669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:00.623597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1360/2727] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:00.631742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.632022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.632295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.658506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:00.659736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:00.668832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1368/2728] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:00.673151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.683578 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5666f-c3e3-4746-b882-7f5e6391a90e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.688216 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.688846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.689134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.689405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.690050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:00.690349 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.692027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.705127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1361/2729] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:00.709617 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.719508 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b01d7-5afd-41bb-ac26-250920e73596 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.724269 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.724905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.725184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.725451 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.726082 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.728546 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.758481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1369/2730] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:00.762849 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.773729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef2467-12d2-46e6-b3a8-b625e36d3589 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.835207 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.835805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.836111 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.836380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.837041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.838970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.864063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1362/2731] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:00.865706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.876742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bdfec-f870-4b0e-b516-b3dde2a0f859 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.881629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.882222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.882496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.882765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.883432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.885050 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.895620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1370/2732] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:00.899684 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.910401 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819b588-6b90-4586-bbeb-540a0faf8de5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.916112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.916746 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.917049 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.917325 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.917999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.919609 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9663c-36eb-4de6-ac19-aeca8bd73598 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.931757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1363/2733] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:00.936038 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.946039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca77495-75eb-4e7c-9823-33ef798addc7 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.950705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.951362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.951636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.951908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] PATH_INFO: `/v3/projects/db184ca9a62e4be9a373bf34aff978b5/users/33e88a7322504d159ecbe8174e049512/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.967949 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db184ca9a62e4be9a373bf34aff978b5, user_id=33e88a7322504d159ecbe8174e049512, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.970650 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.985220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1371/2734] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:00 2022] PUT /identity/v3/projects/db184ca9a62e4be9a373bf34aff978b5/users/33e88a7322504d159ecbe8174e049512/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:00.990602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96bcb-ebcb-4860-99ad-0775fda40789 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.990893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96bcb-ebcb-4860-99ad-0775fda40789 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.991170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd96bcb-ebcb-4860-99ad-0775fda40789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.013432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1bd96bcb-ebcb-4860-99ad-0775fda40789 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:01.014947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1bd96bcb-ebcb-4860-99ad-0775fda40789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.036031 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:01.099343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1364/2735] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:01.109963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.111835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.176995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242edf8-acd6-4368-902e-48f252f5e94e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:01.181414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:01.182014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.182287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.182558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.191657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:01.193091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc1656-643e-4204-aaad-1214bfc3816a service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.202531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1372/2736] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:06.306142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.306636 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.306872 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.339791 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] MFA Rules not processed for user `acc1085d3bcd4c8c93a6c897ef5c9164`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.341159 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.346501 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.347015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.347015 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.377732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] MFA Rules not processed for user `33e88a7322504d159ecbe8174e049512`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.378955 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.415879 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1365/2737] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.442247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.457141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1373/2738] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.458817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.471074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa99e77-3fc3-422a-bf11-fb901b1c4ee6 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.475932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.477864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.478160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.478547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.479181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.481223 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.513558 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1366/2739] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:06.515025 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.526579 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2e474-c414-4b53-9290-636f6cff4971 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.587696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.588403 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.589006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.589150 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.589707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.591622 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.622384 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1374/2740] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:06.623845 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.635249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046832f2-7af2-49f2-a9e5-386d517689bb admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.640016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.640622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.640958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.641232 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.641875 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.643542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.654997 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1367/2741] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:06.659326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.673159 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be66993-02c6-47be-a173-2765545bf983 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.678218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.678887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.679166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.679442 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] PATH_INFO: `/v3/projects/e2a7caf049234bfc998a21eff157373b/users/567006c1464b4bac9025b0dc60d2ba89/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.695881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a7caf049234bfc998a21eff157373b, user_id=567006c1464b4bac9025b0dc60d2ba89, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.698940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.713792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1375/2742] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:06 2022] PUT /identity/v3/projects/e2a7caf049234bfc998a21eff157373b/users/567006c1464b4bac9025b0dc60d2ba89/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:06.718023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.730334 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69118c26-8fbd-4a79-a82e-cc2a53eac729 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.828301 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.828959 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.829297 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.829573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.830512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.831988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.845787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1368/2743] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:06.848978 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.862059 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df7f5c-3453-46eb-82c6-34c03411a289 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.867137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.868496 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.869056 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.869372 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] PATH_INFO: `/v3/projects/e2a7caf049234bfc998a21eff157373b/users/567006c1464b4bac9025b0dc60d2ba89/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.871822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a7caf049234bfc998a21eff157373b, user_id=567006c1464b4bac9025b0dc60d2ba89, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.874507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1808bdd-0538-49e7-959b-2ed09ffa62f9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.888793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1376/2744] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:06 2022] PUT /identity/v3/projects/e2a7caf049234bfc998a21eff157373b/users/567006c1464b4bac9025b0dc60d2ba89/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:09.128439 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.134187 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.156445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a6c6-9b7f-4b9c-8f79-259ee9d0afa2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.246999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:09.299697 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.300567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.300729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.301088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] PATH_INFO: `/v3/users/d156d1fae6934fd1a2af5ac00b033c36` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.303292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d156d1fae6934fd1a2af5ac00b033c36)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.307681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.420394 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd156d1fae6934fd1a2af5ac00b033c36'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.435480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd156d1fae6934fd1a2af5ac00b033c36'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.436483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd156d1fae6934fd1a2af5ac00b033c36'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.437632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd156d1fae6934fd1a2af5ac00b033c36'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.460689 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd156d1fae6934fd1a2af5ac00b033c36'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.485156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1369/2745] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:09 2022] DELETE /identity/v3/users/d156d1fae6934fd1a2af5ac00b033c36 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:09.486106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.486548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.486646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.521811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:09.523043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.693504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1377/2746] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:09.713007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.714565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.813936 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09720135-71ce-42c4-ad22-6949feff0f8b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.824603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.825483 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.825863 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.827901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.848310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.850230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47712421-35af-4d7b-8d3c-e762962e3f04 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.871077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1370/2747] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:10.613522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.615648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.639212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587565-3942-4121-a41f-c38ee34e5144 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:10.654832 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:10.655576 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.655975 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.656344 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] PATH_INFO: `/v3/projects/5208addfaca543bca48d8c446581245e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.658260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5208addfaca543bca48d8c446581245e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:10.677284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.835686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:10.848143 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5208addfaca543bca48d8c446581245e', 'request_id': 'req-99230d82-eeee-462a-a1d3-0ea18a6dac4c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.866954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5208addfaca543bca48d8c446581245e', 'request_id': 'req-99230d82-eeee-462a-a1d3-0ea18a6dac4c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.898706 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5208addfaca543bca48d8c446581245e', 'request_id': 'req-99230d82-eeee-462a-a1d3-0ea18a6dac4c'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.927296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] The token cache is being invalidate because project 5208addfaca543bca48d8c446581245e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:10.927575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.928272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-99230d82-eeee-462a-a1d3-0ea18a6dac4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.937582 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1378/2748] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:10 2022] DELETE /identity/v3/projects/5208addfaca543bca48d8c446581245e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:10.939738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.940199 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.940488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.993678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:10.995628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.124520 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:11.159179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1371/2749] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:11.161043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.161424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.161877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.208213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:11.209517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.240549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1379/2750] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:11.243025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.264290 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cc0ad-d767-4292-8331-f6d47ae2c1b1 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.277972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.280653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.280653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.280653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.280653 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:11.281113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.284184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.318714 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1372/2751] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:11.325630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.339625 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abe699-ac6f-4d3c-b811-f60b91a68343 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.351031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.352487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.352889 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.356222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.356222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.356222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.425745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1380/2752] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:11.431611 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.453081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7e21-4481-4a7f-b055-d874df53bcce admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.568491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.569461 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.569838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.570203 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.571211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.573356 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.629778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1373/2753] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:11.633119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.646499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66c99-d76a-48f7-b1d5-c2d4378e4133 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.672658 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.673314 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.673795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.675758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.676677 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.682655 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.716169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1381/2754] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:11.720109 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.737260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24e691-f7c6-4ce7-96cf-93af59c02a19 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.750051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.751126 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.751633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.752063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.752937 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.755385 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99756709-5b7b-4508-a156-cfbc7047f325 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.792014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1374/2755] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:11.793711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.809623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013df6-a08c-4afb-998c-dc5015ed68e4 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.819971 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.821346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.821628 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.821898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] PATH_INFO: `/v3/projects/f6e747a99c8448d89e14deddb95a5797/users/1675c0e189ba476da27a18aa2f789797/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.844563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6e747a99c8448d89e14deddb95a5797, user_id=1675c0e189ba476da27a18aa2f789797, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.849660 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.885357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1382/2756] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:11 2022] PUT /identity/v3/projects/f6e747a99c8448d89e14deddb95a5797/users/1675c0e189ba476da27a18aa2f789797/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:11.895962 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.896253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.896535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.957011 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] MFA Rules not processed for user `1675c0e189ba476da27a18aa2f789797`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:11.958438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.068041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1375/2757] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:12.075821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.187410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213abdd-811b-4542-ba76-dee867518d53 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.199072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.201719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.202692 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.203068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.206487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.213394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.288469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1383/2758] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/projects => generated 363 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:12.294017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.311431 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0a8b8-dcf0-4a3f-9cc1-5deab177e826 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.395792 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:12.427544 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.428827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.429598 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.431043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.431977 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.434413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.463313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1376/2759] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:12.467127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.480220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff248b-cf80-4c27-a39e-1e49457b8a6c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.494421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.495522 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.496040 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.496525 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.497431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.499721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.524502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1384/2760] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:12.529139 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.544345 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1aca8-30e9-439f-bcd0-811623a6905c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.556985 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.557818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.558247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.558623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] PATH_INFO: `/v3/projects/4676121f7d6f4b0aa14ec98f49d45652/users/6a9b8af2fcc441689d8bb5c333a45a25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.577069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4676121f7d6f4b0aa14ec98f49d45652, user_id=6a9b8af2fcc441689d8bb5c333a45a25, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.579945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.596411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1377/2761] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:12 2022] PUT /identity/v3/projects/4676121f7d6f4b0aa14ec98f49d45652/users/6a9b8af2fcc441689d8bb5c333a45a25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:12.600142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.612898 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c796c2-6cce-41c8-8a80-a4da053f9c64 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.667106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:12.688623 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.689277 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.689559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.689831 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.690485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.692090 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c46ed-091e-4235-9f51-cc251473a1fc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.704309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1385/2762] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:12.708560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.725954 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7ea1e-0add-4c7d-9608-2d81b316fd71 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.732272 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.733190 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.733540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.733932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] PATH_INFO: `/v3/projects/4676121f7d6f4b0aa14ec98f49d45652/users/6a9b8af2fcc441689d8bb5c333a45a25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.736160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4676121f7d6f4b0aa14ec98f49d45652, user_id=6a9b8af2fcc441689d8bb5c333a45a25, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.739251 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.780163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1378/2763] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:12 2022] PUT /identity/v3/projects/4676121f7d6f4b0aa14ec98f49d45652/users/6a9b8af2fcc441689d8bb5c333a45a25/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:12.791019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d43ddd-bb3f-4b0d-b39f-e95a625d29b3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.791019 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d43ddd-bb3f-4b0d-b39f-e95a625d29b3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.791334 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d43ddd-bb3f-4b0d-b39f-e95a625d29b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.833930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-f7d43ddd-bb3f-4b0d-b39f-e95a625d29b3 None None] MFA Rules not processed for user `6a9b8af2fcc441689d8bb5c333a45a25`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:12.835461 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f7d43ddd-bb3f-4b0d-b39f-e95a625d29b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.952465 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1386/2764] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:12.964098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.966593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.064267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7402b4-53ca-43db-855d-eb84e9837373 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.074189 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.074834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.075112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.075383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.089485 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.093621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.137657 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1379/2765] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:13.198300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d9-3eb0-4002-ad99-f9032692a006 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.198654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d9-3eb0-4002-ad99-f9032692a006 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.198968 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d20d9-3eb0-4002-ad99-f9032692a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.260121 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-6d9d20d9-3eb0-4002-ad99-f9032692a006 None None] MFA Rules not processed for user `567006c1464b4bac9025b0dc60d2ba89`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:13.264141 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-6d9d20d9-3eb0-4002-ad99-f9032692a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.460445 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.461728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1387/2766] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:13.462900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.542000 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab373f-a616-40bb-bee9-2196af8de147 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.546529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.547399 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.547783 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.548196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.550230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.656106 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.657844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.663265 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:13.681848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1380/2767] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:13.903532 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.904353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.904353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.943241 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:13.945156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:14.041856 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:14.067209 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1388/2768] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:14.150993 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.152883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:14.280240 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa86dc-92c9-4409-9666-194dbdf1a1cc service glance] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.291789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.292456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.292787 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.293079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.319725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.323421 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363d92d-0fe4-4a65-8618-00c62b452e00 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.355703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1381/2769] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:15.747349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.825973 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc9e56-369f-4f22-8fdb-6c6f9f7a2bb5 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.832024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.832957 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.833338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.833723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] PATH_INFO: `/v3/users/1675c0e189ba476da27a18aa2f789797` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.836102 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1675c0e189ba476da27a18aa2f789797)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.839988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.914930 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1675c0e189ba476da27a18aa2f789797'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.915970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1675c0e189ba476da27a18aa2f789797'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.931296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1675c0e189ba476da27a18aa2f789797'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.955331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1675c0e189ba476da27a18aa2f789797'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.964362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1675c0e189ba476da27a18aa2f789797'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.977653 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1389/2770] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:15 2022] DELETE /identity/v3/users/1675c0e189ba476da27a18aa2f789797 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:15.982392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.982951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.983347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.009643 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:16.011288 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.128557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1382/2771] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:16.142612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:16.145136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.270867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c56-91c0-4cc7-b4e7-39f716d16000 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:16.285002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.285642 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.286400 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.286688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.318043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.319843 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.333884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1390/2772] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:16.798089 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:16.799859 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.831536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72129881-d792-40dd-be4f-14d327647ee2 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:16.839353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.840776 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.841440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.841970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] PATH_INFO: `/v3/projects/f6e747a99c8448d89e14deddb95a5797` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.843941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6e747a99c8448d89e14deddb95a5797)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.846314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.949028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6e747a99c8448d89e14deddb95a5797', 'request_id': 'req-6bb900c6-58d3-4036-905d-40f33de078c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.960388 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6e747a99c8448d89e14deddb95a5797', 'request_id': 'req-6bb900c6-58d3-4036-905d-40f33de078c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.972741 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6e747a99c8448d89e14deddb95a5797', 'request_id': 'req-6bb900c6-58d3-4036-905d-40f33de078c5'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.997135 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] The token cache is being invalidate because project f6e747a99c8448d89e14deddb95a5797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:16.998751 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.000108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.004067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1383/2773] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:16 2022] DELETE /identity/v3/projects/f6e747a99c8448d89e14deddb95a5797 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:17.008027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.020604 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d3008-2a7e-459a-85b2-33b34680b121 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.036574 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:17.121105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.121910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.122212 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.122507 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] PATH_INFO: `/v3/users/6a9b8af2fcc441689d8bb5c333a45a25` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.123733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9b8af2fcc441689d8bb5c333a45a25)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.125789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.204669 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9b8af2fcc441689d8bb5c333a45a25'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.205878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9b8af2fcc441689d8bb5c333a45a25'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.233337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9b8af2fcc441689d8bb5c333a45a25'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.257228 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9b8af2fcc441689d8bb5c333a45a25'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.278554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-8cce90f9-1537-49cc-a835-0468d316eafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9b8af2fcc441689d8bb5c333a45a25'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.291876 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1391/2774] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:17 2022] DELETE /identity/v3/users/6a9b8af2fcc441689d8bb5c333a45a25 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:17.966116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.969375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.009192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb900c6-58d3-4036-905d-40f33de078c5 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.042019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:18.176305 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.177233 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.177677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.178180 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] PATH_INFO: `/v3/projects/4676121f7d6f4b0aa14ec98f49d45652` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.179599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4676121f7d6f4b0aa14ec98f49d45652)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.183380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.513417 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4676121f7d6f4b0aa14ec98f49d45652', 'request_id': 'req-61c89dae-adbd-46da-b819-40eab72afa9d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.525512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4676121f7d6f4b0aa14ec98f49d45652', 'request_id': 'req-61c89dae-adbd-46da-b819-40eab72afa9d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.539244 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4676121f7d6f4b0aa14ec98f49d45652', 'request_id': 'req-61c89dae-adbd-46da-b819-40eab72afa9d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.563513 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] The token cache is being invalidate because project 4676121f7d6f4b0aa14ec98f49d45652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:18.564283 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.565851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-61c89dae-adbd-46da-b819-40eab72afa9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.575050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1384/2775] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:17 2022] DELETE /identity/v3/projects/4676121f7d6f4b0aa14ec98f49d45652 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:18.598902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.598902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.598902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.624337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:18.625864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.755512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1392/2776] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:18.756545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.756858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.757142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.795215 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:18.796972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.812815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1385/2777] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:18.815953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.834991 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb3095-f47e-409b-b2a3-eb624732a4f2 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.842780 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.843811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.844435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.845031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.846169 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:18.846613 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.849995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.879862 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1393/2778] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:18.880862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.891893 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b696ff-0d32-42df-85a2-a5bb9961267f None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.900878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.902033 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.902419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.902700 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.903530 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.905827 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.950051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1386/2779] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:18.954031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.968842 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dd67-e05e-4ab6-b7d4-4b98892ec53c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.028404 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:19.119634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.120497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.120970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.121371 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.122215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.124923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.177895 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1394/2780] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:18 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:19.182331 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.199814 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bec87-a3be-4788-ba1e-f6dd4901d463 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.206100 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.206940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.207316 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.207695 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.224881 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.228642 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.253522 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1387/2781] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:19.257426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.287166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96335d-e286-406a-96b1-827c8c7939de admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.306254 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.307156 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.307536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.307942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.308995 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.311068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ea033-c213-4374-af33-11fa9c9a8716 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.328048 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1395/2782] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:19.332940 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.371853 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796dc55-def1-4737-96c0-7d49f984a066 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.384601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.385337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.385617 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.385889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] PATH_INFO: `/v3/projects/fa0ccf87934e4604a2f3235fa8c17b9d/users/f1718f47d8bc44fe8e4616e6b83507a2/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.407402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ccf87934e4604a2f3235fa8c17b9d, user_id=f1718f47d8bc44fe8e4616e6b83507a2, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.411116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.429634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1388/2783] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:19 2022] PUT /identity/v3/projects/fa0ccf87934e4604a2f3235fa8c17b9d/users/f1718f47d8bc44fe8e4616e6b83507a2/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:19.448030 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.448502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.448814 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.505489 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] MFA Rules not processed for user `f1718f47d8bc44fe8e4616e6b83507a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.506982 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.624954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1396/2784] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:19.631170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.717806 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:19.765770 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49518483-e7b6-40dd-86fa-c7ceac598789 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.775964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.777320 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.777678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.778088 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.778947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.782128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.834020 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1389/2785] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:19.840479 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.855881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd35386-285c-4825-bd1d-07665c3fb5db None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.976419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.977242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.977737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.979529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.979529 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.983181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.046201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1397/2786] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:20.051652 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.069623 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5debf-4c7b-4b19-a6cc-a66dbbab5f1e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.079219 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.081037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.081913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.082402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.083560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.087070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.112405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1390/2787] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:20.118298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.141589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee92ce6-de00-4382-ae1d-dd95e287630d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.152162 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.153412 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.154155 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.154740 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] PATH_INFO: `/v3/projects/02c7c5c863d74328996fc52d493f0a1a/users/a795823fbf714ed1bedb0f0de4389f76/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.196438 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c7c5c863d74328996fc52d493f0a1a, user_id=a795823fbf714ed1bedb0f0de4389f76, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.199751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.203906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:20.231590 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1398/2788] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:20 2022] PUT /identity/v3/projects/02c7c5c863d74328996fc52d493f0a1a/users/a795823fbf714ed1bedb0f0de4389f76/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:20.239518 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.260588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d4024-9f14-4970-a8d2-c8d48be833c9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.392633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.393438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.393924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.394380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.395573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.398293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c30c0-27af-4205-9ba4-de6732434a05 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.413904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1391/2789] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:20.419983 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.434744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be3272-10d7-4e47-ae6f-c1c1b3043656 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.442490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.442490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.442490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.442490 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] PATH_INFO: `/v3/projects/02c7c5c863d74328996fc52d493f0a1a/users/a795823fbf714ed1bedb0f0de4389f76/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.448071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c7c5c863d74328996fc52d493f0a1a, user_id=a795823fbf714ed1bedb0f0de4389f76, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.451764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.468565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1399/2790] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:20 2022] PUT /identity/v3/projects/02c7c5c863d74328996fc52d493f0a1a/users/a795823fbf714ed1bedb0f0de4389f76/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:20.490830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.491117 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.491393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.551130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] MFA Rules not processed for user `a795823fbf714ed1bedb0f0de4389f76`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:20.552798 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:20.668870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1392/2791] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:20.680069 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.684434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:20.754865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d736-dd42-4ebf-abc5-bc2c7049d013 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.758942 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.759559 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.759836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.760113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.875325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.878191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.896795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1400/2792] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:22.501738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:22.504242 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:22.521396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9df703-33b6-43d3-ac28-98904b8022a7 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:22.527480 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:22.528287 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:22.528730 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:22.529129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:22.549732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:22.552392 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f7627-31a5-409e-9755-fbe372751e95 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:22.581130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1393/2793] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:26.698303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.764347 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1f6f-cd55-40c8-916a-6314d7668220 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.764992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1f6f-cd55-40c8-916a-6314d7668220 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.765096 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f666c-f133-472e-bc34-56eb64c500bc service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.765212 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede1f6f-cd55-40c8-916a-6314d7668220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.769682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.770589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.770844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.771108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] PATH_INFO: `/v3/users/f1718f47d8bc44fe8e4616e6b83507a2` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.772233 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1718f47d8bc44fe8e4616e6b83507a2)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.774761 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.786051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-fede1f6f-cd55-40c8-916a-6314d7668220 None None] MFA Rules not processed for user `33e88a7322504d159ecbe8174e049512`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.787271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fede1f6f-cd55-40c8-916a-6314d7668220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.809377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.821992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.829810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1718f47d8bc44fe8e4616e6b83507a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:26.830793 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1718f47d8bc44fe8e4616e6b83507a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:26.839213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1718f47d8bc44fe8e4616e6b83507a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:26.851214 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1718f47d8bc44fe8e4616e6b83507a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:26.853971 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1394/2794] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.858896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1718f47d8bc44fe8e4616e6b83507a2'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:26.864837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1401/2795] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:26 2022] DELETE /identity/v3/users/f1718f47d8bc44fe8e4616e6b83507a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:26.870790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe95ef-d630-4da2-9dae-741c82deef1f None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.871084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe95ef-d630-4da2-9dae-741c82deef1f None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.871411 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe95ef-d630-4da2-9dae-741c82deef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.891786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-9ffe95ef-d630-4da2-9dae-741c82deef1f None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.893027 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9ffe95ef-d630-4da2-9dae-741c82deef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.957322 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1395/2796] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.968620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.970435 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.055243 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.055901 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.056543 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.060215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d4b-a43d-4ad0-be9d-531f7595d27e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:27.064744 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:27.065378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.065708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.065989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.078799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.080368 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.091747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1402/2797] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:27.129164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:27.130659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.212980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1396/2798] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:27.233530 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:27.236216 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.349758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258341b3-91d0-4e2e-8273-af9a65650fbb service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:27.355822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:27.356424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.356696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.357004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.365432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.367027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.375888 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1403/2799] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:27.520882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:27.522707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:27.568146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23af21-0b0d-4b4c-81d9-52c1a82c964e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:27.578292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:27.578292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.578292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.578292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] PATH_INFO: `/v3/projects/fa0ccf87934e4604a2f3235fa8c17b9d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.579294 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0ccf87934e4604a2f3235fa8c17b9d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.582164 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.638703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:27.657538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0ccf87934e4604a2f3235fa8c17b9d', 'request_id': 'req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.666247 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0ccf87934e4604a2f3235fa8c17b9d', 'request_id': 'req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.683597 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0ccf87934e4604a2f3235fa8c17b9d', 'request_id': 'req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.697933 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] The token cache is being invalidate because project fa0ccf87934e4604a2f3235fa8c17b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:27.698333 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.700073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.704583 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1397/2800] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:27 2022] DELETE /identity/v3/projects/fa0ccf87934e4604a2f3235fa8c17b9d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:27.705834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:27.722394 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4074c-ca7b-404d-80ab-b1ad0e1cf96f service swift] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:27.762388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:27.817571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:27.818307 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:27.818648 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:27.819142 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] PATH_INFO: `/v3/users/a795823fbf714ed1bedb0f0de4389f76` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:27.821620 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a795823fbf714ed1bedb0f0de4389f76)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:27.823954 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:27.928512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a795823fbf714ed1bedb0f0de4389f76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.929979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a795823fbf714ed1bedb0f0de4389f76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.942566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a795823fbf714ed1bedb0f0de4389f76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.963318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a795823fbf714ed1bedb0f0de4389f76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.972106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-fbfde849-c319-4dd0-8031-bf540803ddb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a795823fbf714ed1bedb0f0de4389f76'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:27.980177 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1404/2801] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:27 2022] DELETE /identity/v3/users/a795823fbf714ed1bedb0f0de4389f76 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:28.474227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.476056 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.492928 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c777-f9e4-4b3a-8e42-a4970a8ffa1b admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.600120 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.601218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.601715 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.605862 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] PATH_INFO: `/v3/projects/02c7c5c863d74328996fc52d493f0a1a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.608707 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c7c5c863d74328996fc52d493f0a1a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.612321 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.679889 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c7c5c863d74328996fc52d493f0a1a', 'request_id': 'req-009329a7-70b9-45fc-b360-c3079860eceb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.694085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c7c5c863d74328996fc52d493f0a1a', 'request_id': 'req-009329a7-70b9-45fc-b360-c3079860eceb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.708519 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c7c5c863d74328996fc52d493f0a1a', 'request_id': 'req-009329a7-70b9-45fc-b360-c3079860eceb'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.723166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] The token cache is being invalidate because project 02c7c5c863d74328996fc52d493f0a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:28.723470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.724588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-009329a7-70b9-45fc-b360-c3079860eceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.728800 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1398/2802] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:28 2022] DELETE /identity/v3/projects/02c7c5c863d74328996fc52d493f0a1a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:28.733491 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.734034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.734415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.777504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.778747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.885775 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1405/2803] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.895293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.895579 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.895861 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.918381 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.919631 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.933140 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1399/2804] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.934852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.951871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb244e-9d0c-4d3b-9caf-9f36f64e7d89 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.957885 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.958484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.961161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.961448 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.962877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:28.963413 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.965028 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.979018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1406/2805] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:28.984222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.994774 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689e90-5263-4b17-a77d-b0867422f757 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.000127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.000745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.001065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.001335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.001989 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.003909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.044843 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1400/2806] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:29.046728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.058839 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30be92-f13b-492a-867a-6554c9e3827e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.105837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.143764 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.144396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.144719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.145524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.146176 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.148259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.200854 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1407/2807] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:29.202529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.230763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baaf18-020a-4f09-b823-c3d99b1bd16d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.244504 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.245309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.246803 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.247163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.247908 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.249638 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.272383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1401/2808] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:29.277840 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.296306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba037d1b-3da2-446d-892e-3894751a282d admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.327857 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.328721 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.329202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.329697 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.330672 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.332713 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705356dd-32dd-4d49-8ea5-30d89638fd0f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.363290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1408/2809] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:29.364515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.381956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24078d-f756-4fad-b406-e3db70768256 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.414953 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.416237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.416675 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.417295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] PATH_INFO: `/v3/projects/7750ce28da424db9a121a73a15a6f972/users/8cac71935261464b8f50b7d53fa420d7/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.450605 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.456273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7750ce28da424db9a121a73a15a6f972, user_id=8cac71935261464b8f50b7d53fa420d7, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.460838 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01522124-79ae-4207-bfe8-5a298630ff18 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.482184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1402/2810] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:29 2022] PUT /identity/v3/projects/7750ce28da424db9a121a73a15a6f972/users/8cac71935261464b8f50b7d53fa420d7/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:29.495198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.496135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.496485 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.541043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] MFA Rules not processed for user `8cac71935261464b8f50b7d53fa420d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:29.545256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.632728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1409/2811] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:29.634909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709afc-8879-4363-ba18-519080c75792 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.635538 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709afc-8879-4363-ba18-519080c75792 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.636067 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709afc-8879-4363-ba18-519080c75792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.637970 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.664512 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-bc709afc-8879-4363-ba18-519080c75792 None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:29.666823 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bc709afc-8879-4363-ba18-519080c75792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.712389 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da390e4c-d7aa-4b99-a8aa-5e4a94576dcb None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.718116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.718437 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.718829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.719197 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.720247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.722499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.760243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1410/2812] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:29.764474 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.778496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1403/2813] 10.222.0.70 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:29.814065 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709afc-8879-4363-ba18-519080c75792 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.816735 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-bc709afc-8879-4363-ba18-519080c75792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.829724 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.888748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f65ad-c150-4ba2-afca-bf6614cfedfc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.899099 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.901041 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.901329 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.902202 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.903558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.906357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.971385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1411/2814] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:29 2022] POST /identity/v3/users => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:29.972493 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.984012 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709afc-8879-4363-ba18-519080c75792 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.999339 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf2fc-56b1-4b3f-82ed-caeea804f497 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.006146 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.006763 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.007308 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.007586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.008350 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.010439 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.022927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1412/2815] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.028899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.043270 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed05958-5b68-4bcf-a96a-7f45c7826f74 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.049033 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.049929 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.050369 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.050821 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] PATH_INFO: `/v3/projects/c00061476d174e7980b4cda886505168/users/9b97b61e3adb480bab3a3fac6f1d321d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.069563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00061476d174e7980b4cda886505168, user_id=9b97b61e3adb480bab3a3fac6f1d321d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.074201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.080732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.081592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.082284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.082848 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.101827 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1413/2816] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:30 2022] PUT /identity/v3/projects/c00061476d174e7980b4cda886505168/users/9b97b61e3adb480bab3a3fac6f1d321d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:30.106275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.147574 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:30.200834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.202443 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.218063 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1404/2817] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:54:30.240390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d32c30-b2bc-4a15-b31b-c43477f1537c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.252137 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.253053 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.253521 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.253953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.254765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.256548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.290563 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1414/2818] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:30.294407 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.310303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a802d5c-ad82-476e-8190-f4820596f099 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.325621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.326437 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.326911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.327261 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] PATH_INFO: `/v3/projects/c00061476d174e7980b4cda886505168/users/9b97b61e3adb480bab3a3fac6f1d321d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.333788 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00061476d174e7980b4cda886505168, user_id=9b97b61e3adb480bab3a3fac6f1d321d, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.336497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd45c3-0cf6-4d92-aac0-f03df4177d5d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.354830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1405/2819] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:30 2022] PUT /identity/v3/projects/c00061476d174e7980b4cda886505168/users/9b97b61e3adb480bab3a3fac6f1d321d/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:30.359762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.362410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.366253 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305c40f-4824-475f-827e-6039e485d151 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.366777 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305c40f-4824-475f-827e-6039e485d151 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.367191 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305c40f-4824-475f-827e-6039e485d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.451813 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c305c40f-4824-475f-827e-6039e485d151 None None] MFA Rules not processed for user `9b97b61e3adb480bab3a3fac6f1d321d`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:30.460673 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c305c40f-4824-475f-827e-6039e485d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.477431 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c3f43-b7c5-4b8c-bf33-7f130e361f87 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.550779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:30.610586 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.611633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.612075 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.612509 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.614792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.640129 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.642024 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.670250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1415/2820] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:30.673389 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1406/2821] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:30.678748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.680589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.805910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572b5fa-e47a-4cba-9614-8d29ba18d79d service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.810531 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.811636 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.811989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.812333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.823500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.827759 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.856963 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1416/2822] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:30.911785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305c40f-4824-475f-827e-6039e485d151 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.914358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c305c40f-4824-475f-827e-6039e485d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.935282 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305c40f-4824-475f-827e-6039e485d151 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.940710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.941837 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.942344 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.943128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.051743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.053424 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.105210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1407/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:31.840601 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.842902 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.072301 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bcae1-cbb2-4810-9f5f-ed5d85de61fd service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.120094 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.121106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.121589 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.122031 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.126407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.162874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.165829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47435473-640c-40d1-bc54-bc77e02c7376 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.183328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1417/2824] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:35.780870 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:35.917057 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:35.941829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8fc2-c601-401c-ae19-336269f5aa36 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:35.949380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:35.950818 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:35.951213 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:35.951894 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] PATH_INFO: `/v3/users/8cac71935261464b8f50b7d53fa420d7` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:35.954051 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cac71935261464b8f50b7d53fa420d7)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:35.957716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.026281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cac71935261464b8f50b7d53fa420d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.037372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cac71935261464b8f50b7d53fa420d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.038352 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cac71935261464b8f50b7d53fa420d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.040450 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cac71935261464b8f50b7d53fa420d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.062725 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cac71935261464b8f50b7d53fa420d7'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:36.089130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1408/2825] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:35 2022] DELETE /identity/v3/users/8cac71935261464b8f50b7d53fa420d7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:36.094113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.094944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.094944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.120281 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:36.122528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.222714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1418/2826] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:36.234458 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.236368 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:36.335568 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fc42d-27d6-4060-847f-697a39377dae admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:36.341370 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:36.342723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:36.343146 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:36.343492 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:36.356920 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:36.363404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:36.390070 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1409/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:36.972513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:36.972513 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:37.044596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38ff22-62d7-4799-9eba-ed065fd70bad None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.065312 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:37.066837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.067614 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.068222 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] PATH_INFO: `/v3/projects/7750ce28da424db9a121a73a15a6f972` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.070236 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7750ce28da424db9a121a73a15a6f972)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:37.074557 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:37.078071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=100 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:37.220338 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7750ce28da424db9a121a73a15a6f972', 'request_id': 'req-309ea913-d30f-411a-8e39-fe7b5d56cf9f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.237701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7750ce28da424db9a121a73a15a6f972', 'request_id': 'req-309ea913-d30f-411a-8e39-fe7b5d56cf9f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.260498 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7750ce28da424db9a121a73a15a6f972', 'request_id': 'req-309ea913-d30f-411a-8e39-fe7b5d56cf9f'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.283829 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] The token cache is being invalidate because project 7750ce28da424db9a121a73a15a6f972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:37.284182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.284887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.286598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1419/2828] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:36 2022] DELETE /identity/v3/projects/7750ce28da424db9a121a73a15a6f972 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:37.291281 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:37.303092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96f17f-6756-40b4-9329-5f29f337435f service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:37.453487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:37.454142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:37.454423 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:37.454691 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] PATH_INFO: `/v3/users/9b97b61e3adb480bab3a3fac6f1d321d` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:37.459678 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b97b61e3adb480bab3a3fac6f1d321d)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:37.462670 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:37.488913 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:37.559157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b97b61e3adb480bab3a3fac6f1d321d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.566182 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b97b61e3adb480bab3a3fac6f1d321d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.566960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b97b61e3adb480bab3a3fac6f1d321d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.567608 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b97b61e3adb480bab3a3fac6f1d321d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.588380 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-cd1dad06-d416-4d1d-ba1a-55c588436095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b97b61e3adb480bab3a3fac6f1d321d'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:37.625910 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1410/2829] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:37 2022] DELETE /identity/v3/users/9b97b61e3adb480bab3a3fac6f1d321d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:38.257349 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:38.260250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:38.302242 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea913-d30f-411a-8e39-fe7b5d56cf9f admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:38.406397 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:38.407972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.407972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.407972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] PATH_INFO: `/v3/projects/c00061476d174e7980b4cda886505168` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.409131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00061476d174e7980b4cda886505168)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:38.411424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:38.551145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00061476d174e7980b4cda886505168', 'request_id': 'req-d55e2223-f29c-4361-83d5-e4df795bf07a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:38.570356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00061476d174e7980b4cda886505168', 'request_id': 'req-d55e2223-f29c-4361-83d5-e4df795bf07a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:38.590935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00061476d174e7980b4cda886505168', 'request_id': 'req-d55e2223-f29c-4361-83d5-e4df795bf07a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:38.613687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] The token cache is being invalidate because project c00061476d174e7980b4cda886505168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:38.614361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:38.617284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d55e2223-f29c-4361-83d5-e4df795bf07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:38.620247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1420/2830] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:38 2022] DELETE /identity/v3/projects/c00061476d174e7980b4cda886505168 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:38.626105 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.626658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.626658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.683404 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:38.690017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:38.918503 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1411/2831] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:38.925714 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:38.926072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:38.926370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:38.988583 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:38.991855 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:39.031011 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1421/2832] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:39.036547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.059169 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1849be-0736-4f8b-95c0-d3a9487584d5 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.079338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.079970 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.080250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.080526 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.081222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:39.081523 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.083156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.172303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1412/2833] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:39.176972 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.189552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbaf7e-d63b-4331-9af2-c46a04515f5e None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.210690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.214906 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.215841 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.217238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.220084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.228890 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.271148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:39.306652 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1422/2834] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:39 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:39.312432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.337575 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd287a-d95a-4f87-b91f-da2c918ed0dd admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.500616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.503572 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.504659 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.506041 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.509200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.512952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.572547 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1413/2835] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:39 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:39.577251 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.597555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bcc06-d04a-4c8f-a29a-93157e2302ac admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.604182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.605095 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.610401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.610861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.611872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.613680 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.629071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1423/2836] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:39.633353 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.652201 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caad61-4d71-4cc0-8e0d-c4b4606a9159 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.665721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.667125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.668171 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.668606 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.671974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.675765 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649fae-628c-456c-929d-c4c49dca98b9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.681115 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:39.708736 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:39.717668 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1414/2837] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:39.725120 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f9473-5fae-4f53-9e91-7de346db4af5 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:39.737797 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:39.739430 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.741000 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.741370 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] PATH_INFO: `/v3/projects/d986cb4b69a84deeb72127977ae27a1c/users/ad58cb4b54da4c0389c74cb6211f66d2/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.795191 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d986cb4b69a84deeb72127977ae27a1c, user_id=ad58cb4b54da4c0389c74cb6211f66d2, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:39.799722 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:39.835420 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1424/2838] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:39 2022] PUT /identity/v3/projects/d986cb4b69a84deeb72127977ae27a1c/users/ad58cb4b54da4c0389c74cb6211f66d2/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:39.846626 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:39.846974 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:39.847211 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:39.902789 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] MFA Rules not processed for user `ad58cb4b54da4c0389c74cb6211f66d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:39.907132 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:40.074532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1415/2839] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:40.078766 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.210272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce161c-6afe-4b94-bd7c-ebc9be712ed1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.219377 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.220686 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.221004 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.221278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.221943 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.223921 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.301676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.302734 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1425/2840] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:40 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:40.366045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e39c8-0f71-4c7b-93ed-08036281353c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.468218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.469681 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.471194 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.471699 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.473938 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.478266 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.519237 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1416/2841] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:40 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:40.522679 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.548105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c68c60-f22d-4f3d-abee-330d68a2615c admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.561795 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.563388 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.563657 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.565777 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.566536 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.571779 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.617395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1426/2842] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:40.619110 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.643205 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88969bf1-4cfc-4fa5-a3ae-090d194b67a7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.658976 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.660273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.660666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.661179 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] PATH_INFO: `/v3/projects/213b792a857f4a87a9bc817728ee6126/users/423f92ce525141cfaf762b215ee3f48b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.686193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213b792a857f4a87a9bc817728ee6126, user_id=423f92ce525141cfaf762b215ee3f48b, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.691090 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.718587 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1417/2843] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:40 2022] PUT /identity/v3/projects/213b792a857f4a87a9bc817728ee6126/users/423f92ce525141cfaf762b215ee3f48b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:40.723836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.742765 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4ec2d-d675-469c-a238-37edcc28c610 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.873743 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.874644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.874951 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.875267 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.876353 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.880286 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461bda1-7f1a-4456-84e0-29d78f466517 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.907163 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:40.921956 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1427/2844] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:40.938452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25705886-d089-4b95-be08-d0730b777059 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:40.944046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:40.945069 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.945395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.945665 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] PATH_INFO: `/v3/projects/213b792a857f4a87a9bc817728ee6126/users/423f92ce525141cfaf762b215ee3f48b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:40.949396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=213b792a857f4a87a9bc817728ee6126, user_id=423f92ce525141cfaf762b215ee3f48b, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:40.952918 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:40.973125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1418/2845] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:40 2022] PUT /identity/v3/projects/213b792a857f4a87a9bc817728ee6126/users/423f92ce525141cfaf762b215ee3f48b/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:40.986071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.986359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.986822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.054201 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] MFA Rules not processed for user `423f92ce525141cfaf762b215ee3f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:41.056255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.085172 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.186899 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1428/2846] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:41.208246 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:41.210408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.279258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.303470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7a7cb-a806-4fa6-bfaa-3571d7a3ba9d admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:41.308425 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:41.309440 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:41.309947 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:41.310444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.402682 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:41.421529 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634db23-0fe3-4024-9e57-7886a62928e4 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:41.439313 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1419/2847] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:46.802570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:46.812863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325981f-e5b8-40f8-9dd4-2c652c39b6ac None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:46.816348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:46.817072 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:46.817348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:46.817618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:46.832385 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:46.833912 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:46.844558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1429/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:47.936064 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:47.936555 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:47.936661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:47.956646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:47.957896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.015855 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1420/2849] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:48.028570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:48.029997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:48.099119 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c609-c9d2-45a5-87d5-0ce3593979c2 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:48.104656 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:48.105284 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:48.105564 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:48.105836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:48.113720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:48.115283 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:48.124081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1430/2850] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:50.361475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.362992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.432183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365362eb-ed94-40b0-8ea0-39cee1863c0a None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.437081 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.437705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.437980 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.438249 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] PATH_INFO: `/v3/users/acc1085d3bcd4c8c93a6c897ef5c9164` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.439393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc1085d3bcd4c8c93a6c897ef5c9164)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.441375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.482943 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.489703 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc1085d3bcd4c8c93a6c897ef5c9164'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.497592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc1085d3bcd4c8c93a6c897ef5c9164'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.498214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc1085d3bcd4c8c93a6c897ef5c9164'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.498866 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc1085d3bcd4c8c93a6c897ef5c9164'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.511820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-86dce4ec-97a8-48c7-aeba-246728aa9d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc1085d3bcd4c8c93a6c897ef5c9164'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.523968 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1421/2851] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:50 2022] DELETE /identity/v3/users/acc1085d3bcd4c8c93a6c897ef5c9164 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.697466 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:50.710088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701fcb9-55aa-409b-bc27-ef609a443597 service swift] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:50.774661 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:50.775309 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.775575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.775849 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] PATH_INFO: `/v3/projects/f2023bd5d0134c8d9480b84e7e397db3` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.777047 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2023bd5d0134c8d9480b84e7e397db3)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:50.779362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:50.817675 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:50.832392 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2023bd5d0134c8d9480b84e7e397db3', 'request_id': 'req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.839073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2023bd5d0134c8d9480b84e7e397db3', 'request_id': 'req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.846512 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2023bd5d0134c8d9480b84e7e397db3', 'request_id': 'req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.857719 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] The token cache is being invalidate because project f2023bd5d0134c8d9480b84e7e397db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:50.858018 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.858715 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-2f131b82-b1c6-4ca9-a122-d2599c1ed7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:50.860217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1431/2852] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:50 2022] DELETE /identity/v3/projects/f2023bd5d0134c8d9480b84e7e397db3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:50.865593 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.865884 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.866160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.888137 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:50.889410 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.956077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1422/2853] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:50.965484 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:50.965908 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:50.966306 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:50.987910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:50.989333 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:50.998893 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1432/2854] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:51.003092 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.013854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249a380-2188-41f1-b2d7-76491f65f445 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.018500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.019101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.019382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.019650 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.020292 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:51.020723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.022616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.035929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1423/2855] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:51.040813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.050249 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03b363-49f5-414f-b8e0-ebc7ee378267 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.054887 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.055476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.056278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.056555 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.057230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.059111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.087634 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1433/2856] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:51.091864 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.102141 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69455c00-ed8f-470a-bfb5-b8ac8b2677f2 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.159230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.159736 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.160008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.160274 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.160924 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.162822 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.185025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1424/2857] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:51.189085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.199837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890026-6f62-475c-b3a1-fb48b1ad8ea1 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.204328 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.204935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.205213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.205487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.206116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.207688 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.217875 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1434/2858] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:51.221956 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.232441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c21a-26d7-4b71-92b9-9b1181c5450f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.237444 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.238030 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.238307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.238601 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.239230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.240836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b509b-682f-47e2-852d-e30d8cf06531 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.252397 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1425/2859] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:51.256588 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.267717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a334f9-a074-41eb-83fa-069fb0c1076b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.272598 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.273264 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.273837 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.274117 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] PATH_INFO: `/v3/projects/36f93e4c2d8b4c9b8c7bb526132c6e1e/users/dd0608a99f5c4ea6a7f7769429a8df14/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.288923 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f93e4c2d8b4c9b8c7bb526132c6e1e, user_id=dd0608a99f5c4ea6a7f7769429a8df14, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.291596 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.304246 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1435/2860] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:51 2022] PUT /identity/v3/projects/36f93e4c2d8b4c9b8c7bb526132c6e1e/users/dd0608a99f5c4ea6a7f7769429a8df14/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:51.314698 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.314979 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.315256 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.343008 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] MFA Rules not processed for user `dd0608a99f5c4ea6a7f7769429a8df14`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:51.344200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.354048 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:51.410929 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1426/2861] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:51.422678 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.424396 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.482217 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d967-5882-4d27-b8f6-e5c7ef4be9bd admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.486230 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7089e9cdf205484b96a23fe75805d0d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.486481 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.486763 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.487037 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.496571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.498052 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71326e-891e-4626-ae4b-87c1d03a21c9 service glance] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.506863 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1436/2862] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:51.786732 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:51.789260 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:51.869420 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a8b4-3c42-4c98-903a-b56553bcb23e None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:51.873904 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:51.874537 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:51.874820 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:51.875096 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] PATH_INFO: `/v3/users/ad58cb4b54da4c0389c74cb6211f66d2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:51.876406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad58cb4b54da4c0389c74cb6211f66d2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:51.878772 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:51.992834 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad58cb4b54da4c0389c74cb6211f66d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.001836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad58cb4b54da4c0389c74cb6211f66d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.003134 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad58cb4b54da4c0389c74cb6211f66d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.004014 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad58cb4b54da4c0389c74cb6211f66d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.033811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad58cb4b54da4c0389c74cb6211f66d2'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.059084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1427/2863] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:51 2022] DELETE /identity/v3/users/ad58cb4b54da4c0389c74cb6211f66d2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:52.066199 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.066782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.067181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.110745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:52.117737 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.211683 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.230326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1437/2864] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:52.244442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.246038 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.292705 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.320432 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368f88d-3da5-4384-abb2-a367d5433ff8 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.324545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.325317 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.325540 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.326068 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.335739 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.338032 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.347372 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1428/2865] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:52.643243 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.645272 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:52.658223 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25509d-6e1d-4cde-a4d1-68066d75e0a9 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.662815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.663447 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.663717 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.664010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] PATH_INFO: `/v3/projects/d986cb4b69a84deeb72127977ae27a1c` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.666135 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d986cb4b69a84deeb72127977ae27a1c)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.668944 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.724772 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd986cb4b69a84deeb72127977ae27a1c', 'request_id': 'req-44832fe5-76a7-4f27-a481-4bd7898b56ea'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.732292 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd986cb4b69a84deeb72127977ae27a1c', 'request_id': 'req-44832fe5-76a7-4f27-a481-4bd7898b56ea'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.741874 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd986cb4b69a84deeb72127977ae27a1c', 'request_id': 'req-44832fe5-76a7-4f27-a481-4bd7898b56ea'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.754325 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] The token cache is being invalidate because project d986cb4b69a84deeb72127977ae27a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:52.754618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.755265 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.756742 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1438/2866] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:52 2022] DELETE /identity/v3/projects/d986cb4b69a84deeb72127977ae27a1c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:52.760815 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:52.772786 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416dab-935c-4b2f-b172-80036ccc6484 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:52.843143 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:52.843832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:52.844113 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:52.844386 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] PATH_INFO: `/v3/users/423f92ce525141cfaf762b215ee3f48b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:52.845615 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423f92ce525141cfaf762b215ee3f48b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:52.847586 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:52.896612 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423f92ce525141cfaf762b215ee3f48b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.904564 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423f92ce525141cfaf762b215ee3f48b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.905206 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423f92ce525141cfaf762b215ee3f48b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.905851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423f92ce525141cfaf762b215ee3f48b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.919779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-23a94e8f-f325-43e8-857a-775f259a54c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423f92ce525141cfaf762b215ee3f48b'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:52.933074 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1429/2867] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:52 2022] DELETE /identity/v3/users/423f92ce525141cfaf762b215ee3f48b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:53.240904 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.242390 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.257787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832fe5-76a7-4f27-a481-4bd7898b56ea admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.325997 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.326638 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.326914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.327183 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] PATH_INFO: `/v3/projects/213b792a857f4a87a9bc817728ee6126` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.328300 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213b792a857f4a87a9bc817728ee6126)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.330213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.380361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213b792a857f4a87a9bc817728ee6126', 'request_id': 'req-9de96b6d-e419-44a0-8d63-39f791569778'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.388068 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213b792a857f4a87a9bc817728ee6126', 'request_id': 'req-9de96b6d-e419-44a0-8d63-39f791569778'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.397130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213b792a857f4a87a9bc817728ee6126', 'request_id': 'req-9de96b6d-e419-44a0-8d63-39f791569778'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.413568 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] The token cache is being invalidate because project 213b792a857f4a87a9bc817728ee6126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:53.413853 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.414502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-9de96b6d-e419-44a0-8d63-39f791569778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:53.416727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1439/2868] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:53 2022] DELETE /identity/v3/projects/213b792a857f4a87a9bc817728ee6126 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:53.422975 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.423250 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.423515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.445877 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:53.447173 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.499402 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:53.514043 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1430/2869] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:53.522326 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.522603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.522871 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.544055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:53.545295 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.553434 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1440/2870] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:53.557766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.567496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68605bba-d394-4435-b9d1-c7e766628dad None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.572654 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.573277 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.573557 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.573832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.574474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:53.574766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.576361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.588406 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1431/2871] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:53.593457 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.599140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:53.603061 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c1b7e-1e30-4e4d-b3a4-196a632fbbe3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.609198 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.609749 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.610034 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.610517 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.611373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.613528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.641402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1441/2872] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:53.645634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.656811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d82ac2-137b-4061-ada3-92e18e952551 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.716285 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.716934 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.717214 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.717487 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.718125 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.720052 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.741181 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1432/2873] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:53.745566 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.756002 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6335d6-60c8-4210-9880-3b34e79dcbc9 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.761537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.762179 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.762454 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.762732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.763379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.765080 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.776196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1442/2874] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:53.780263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.792326 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3786f-83a9-4568-bb8f-29ea653bf3b6 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.797972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.798622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.798903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.799174 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.799812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.801486 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48b0cb-71a4-4fef-a4a1-e0948dea511b admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.812734 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1433/2875] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:53.816927 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:53.827816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155e987-cf57-4c17-8bd7-9341b963bd81 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:53.832967 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:53.833631 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.833907 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.834173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] PATH_INFO: `/v3/projects/674ac37b431f4d4b983419bc4343bab2/users/015741034f2d4779af4a2b002c9fa2a6/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.851725 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=674ac37b431f4d4b983419bc4343bab2, user_id=015741034f2d4779af4a2b002c9fa2a6, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:53.855184 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:53.869565 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1443/2876] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:53 2022] PUT /identity/v3/projects/674ac37b431f4d4b983419bc4343bab2/users/015741034f2d4779af4a2b002c9fa2a6/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:53.942952 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.943230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.943506 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.975761 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] MFA Rules not processed for user `015741034f2d4779af4a2b002c9fa2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:53.977023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.047588 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1434/2877] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:54.052487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.071319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.074108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.133128 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9d30-ad86-47a9-9ea3-e5286c1352ae admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.141122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.141731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.142008 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.142274 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.142905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.144877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.151554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.178799 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1444/2878] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:54.182783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.189329 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b014cf-78d7-42a4-8e6f-5c3f09925462 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.254788 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10061ec5-93c2-431c-9c37-d7ef95468574 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.260363 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.261064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.261282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.261535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.262161 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.264073 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.267964 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.268576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.268883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.269157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.271452 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.289050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.290919 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.295497 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1445/2879] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:54.299432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.302255 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1435/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:54.310883 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ef9a-a0e5-4a57-9468-2e3bcf0daeef admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.316116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.316818 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.317085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.317359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.318022 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.319635 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.332173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1446/2881] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:54.336476 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.349291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f4944-9e6b-4ef6-a799-e6b1e0957b37 service nova] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.355446 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.356116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.356116 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.356337 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] PATH_INFO: `/v3/projects/29bdd6e122884f7fbce4db58a293e68a/users/3f5e9f48c7204edfb0b6de4c2cb577f4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.373236 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bdd6e122884f7fbce4db58a293e68a, user_id=3f5e9f48c7204edfb0b6de4c2cb577f4, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.375945 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.391343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1436/2882] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:54 2022] PUT /identity/v3/projects/29bdd6e122884f7fbce4db58a293e68a/users/3f5e9f48c7204edfb0b6de4c2cb577f4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:54.395846 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.407587 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810380b-53a1-455f-a1a6-a17ed64f42de admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.416771 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.484316 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.485106 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.485458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.485813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.486511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.488178 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39bdc1-b2e7-4b2f-877b-bcd5b74ac8b8 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.504668 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1447/2883] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:54.509599 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.520351 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3aec2-eb97-469f-928a-441884fafe54 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.526252 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.526922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.527200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.527478 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] PATH_INFO: `/v3/projects/29bdd6e122884f7fbce4db58a293e68a/users/3f5e9f48c7204edfb0b6de4c2cb577f4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.529874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bdd6e122884f7fbce4db58a293e68a, user_id=3f5e9f48c7204edfb0b6de4c2cb577f4, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.532663 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.549755 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1437/2884] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:54 2022] PUT /identity/v3/projects/29bdd6e122884f7fbce4db58a293e68a/users/3f5e9f48c7204edfb0b6de4c2cb577f4/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:54.561958 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.562280 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.562528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.599990 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] MFA Rules not processed for user `3f5e9f48c7204edfb0b6de4c2cb577f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:54.601260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.685153 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1448/2885] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:54.696210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:54.698658 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:54.761276 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa93b-4322-4d13-8d08-28a87cb276ad admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:54.765273 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:54.765878 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:54.766150 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:54.766416 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:54.818062 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:54.829496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:54.831079 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63626-e4c5-479b-82fe-3ce474f15de3 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:54.840393 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1438/2886] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:57.429318 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.495618 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2983-4407-44cb-a69a-95f06c6188a8 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.501200 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.502285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.502562 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.502833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] PATH_INFO: `/v3/users/015741034f2d4779af4a2b002c9fa2a6` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.504042 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015741034f2d4779af4a2b002c9fa2a6)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.506057 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.547381 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:57.559112 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015741034f2d4779af4a2b002c9fa2a6'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:57.559776 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015741034f2d4779af4a2b002c9fa2a6'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:57.569768 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015741034f2d4779af4a2b002c9fa2a6'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:57.586548 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015741034f2d4779af4a2b002c9fa2a6'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:57.604323 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015741034f2d4779af4a2b002c9fa2a6'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:57.605762 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1449/2887] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:57 2022] DELETE /identity/v3/users/015741034f2d4779af4a2b002c9fa2a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:57.610622 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.611053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.611053 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.632263 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:57.633481 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:57.699086 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1439/2888] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:57.709533 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:57.711343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:57.776290 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cafd2-228a-4e49-9895-d79cd8931275 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:57.781071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:57.781810 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:57.782256 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:57.782534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:57.796641 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:57.798111 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:57.809789 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1450/2889] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:58.101071 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:58.102567 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:58.117127 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c376a-b9f3-4608-8922-71e785effbfd None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:58.123382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:58.124339 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:58.124468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:58.124852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] PATH_INFO: `/v3/projects/674ac37b431f4d4b983419bc4343bab2` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:58.126307 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674ac37b431f4d4b983419bc4343bab2)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:58.128371 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:58.177620 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674ac37b431f4d4b983419bc4343bab2', 'request_id': 'req-d0905814-cbe5-45f5-bd8d-0835a134dc32'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.183874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674ac37b431f4d4b983419bc4343bab2', 'request_id': 'req-d0905814-cbe5-45f5-bd8d-0835a134dc32'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.191536 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674ac37b431f4d4b983419bc4343bab2', 'request_id': 'req-d0905814-cbe5-45f5-bd8d-0835a134dc32'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.202405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] The token cache is being invalidate because project 674ac37b431f4d4b983419bc4343bab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:58.202687 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.203303 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.204781 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1440/2890] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:58 2022] DELETE /identity/v3/projects/674ac37b431f4d4b983419bc4343bab2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:58.209238 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:58.219792 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215260e9-1cc2-4579-b5e8-1660c3507cd9 service neutron] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:58.279731 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:58.280379 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:58.280665 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:58.280966 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] PATH_INFO: `/v3/users/3f5e9f48c7204edfb0b6de4c2cb577f4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:58.282113 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e9f48c7204edfb0b6de4c2cb577f4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:58.284039 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:58.334758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e9f48c7204edfb0b6de4c2cb577f4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.335402 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e9f48c7204edfb0b6de4c2cb577f4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.345535 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e9f48c7204edfb0b6de4c2cb577f4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.349205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:58.369157 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e9f48c7204edfb0b6de4c2cb577f4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.376357 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-6a97fc2e-8850-4984-a95b-2d47c1d1520a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e9f48c7204edfb0b6de4c2cb577f4'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.383646 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1451/2891] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:58 2022] DELETE /identity/v3/users/3f5e9f48c7204edfb0b6de4c2cb577f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:58.676471 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:58.677999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:58.692271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0905814-cbe5-45f5-bd8d-0835a134dc32 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:58.761124 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:58.762343 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:58.762627 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:58.762903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] PATH_INFO: `/v3/projects/29bdd6e122884f7fbce4db58a293e68a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:58.764099 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bdd6e122884f7fbce4db58a293e68a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:58.766084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:58.782565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:58.818909 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bdd6e122884f7fbce4db58a293e68a', 'request_id': 'req-2ab9da7a-557d-4b95-8724-611e5bc8b5df'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.825690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bdd6e122884f7fbce4db58a293e68a', 'request_id': 'req-2ab9da7a-557d-4b95-8724-611e5bc8b5df'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.835084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bdd6e122884f7fbce4db58a293e68a', 'request_id': 'req-2ab9da7a-557d-4b95-8724-611e5bc8b5df'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.846396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] The token cache is being invalidate because project 29bdd6e122884f7fbce4db58a293e68a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:58.846677 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.847338 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2ab9da7a-557d-4b95-8724-611e5bc8b5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:58.848846 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1441/2892] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:58 2022] DELETE /identity/v3/projects/29bdd6e122884f7fbce4db58a293e68a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:58.854278 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:58.854787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:58.854886 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:58.875205 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:58.876444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:58.936575 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1452/2893] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:58.944306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:58.944721 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:58.945037 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:58.965951 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:58.967158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:58.981459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1442/2894] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:58.985791 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:58.996044 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc3677-0962-4177-8c8a-334180283b2c None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.000733 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.001359 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.001629 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.001896 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] PATH_INFO: `/v3/domains` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.002534 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81678) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:59.002833 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.004410 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.020732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1453/2895] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:59.026545 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.036589 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d55340-a139-4c1d-91bd-8f0f52c89c25 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.041880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.042552 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.042836 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.043129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.043757 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.045676 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.080510 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1443/2896] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:59.084783 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.095619 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841423f4-0fdc-4245-b481-daab127db873 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.155499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.156296 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.156603 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.157005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.157654 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.159988 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.189987 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1454/2897] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:59.194078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.206784 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5b072-df7a-4e1b-b06a-d8095dc6ef74 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.211596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.212839 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.213685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.213685 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.214286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.215830 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.226576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1444/2898] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:59.231514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.241819 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533f461-a111-4e02-8fe5-335c5062cdbf admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.247098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.247699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.247980 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.248247 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.248925 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.250520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913c44d-5171-48c7-ba22-66150bcde7a3 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.262244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1455/2899] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:59.266634 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.278177 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087125f-2426-47d8-8f7a-c9e080eca95a admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.282896 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.283408 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.283686 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.284284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] PATH_INFO: `/v3/projects/2385600649024b919a0b190f7af5f365/users/099cd3c75f11444d8a2db5eba320c48a/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.299906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2385600649024b919a0b190f7af5f365, user_id=099cd3c75f11444d8a2db5eba320c48a, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.302596 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.322278 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1445/2900] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:59 2022] PUT /identity/v3/projects/2385600649024b919a0b190f7af5f365/users/099cd3c75f11444d8a2db5eba320c48a/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:59.333816 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c090-e818-47b3-933c-39341194da59 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.334100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c090-e818-47b3-933c-39341194da59 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.334375 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33c090-e818-47b3-933c-39341194da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.365089 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-4e33c090-e818-47b3-933c-39341194da59 None None] MFA Rules not processed for user `099cd3c75f11444d8a2db5eba320c48a`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:59.366378 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4e33c090-e818-47b3-933c-39341194da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:59.408345 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:59.455469 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1456/2901] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:59.460218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.532635 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba5679-4efd-4206-bf63-1e7764d7967f admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.538986 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.539603 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.539887 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.540185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.541594 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.543621 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.577865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1446/2902] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:59.581931 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c090-e818-47b3-933c-39341194da59 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.607935 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33c090-e818-47b3-933c-39341194da59 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.671361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.671981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.672257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.672524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.673196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.675100 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.698852 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1457/2903] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:59.703016 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.714688 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518172a-291c-4255-b605-88eef82ce38c admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.721289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.721903 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.722209 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.722472 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.723185 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.724927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.741107 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1447/2904] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:59.742346 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.753380 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219a5a-dc5d-4f6d-8cc3-3faba0de3362 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.758105 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.758705 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.759627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.759910 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.760723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.762567 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f99a8-6646-4dae-bb5d-0d74f68bae33 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.773331 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1458/2905] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:59.779077 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:59.789491 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e918d0-1b69-43e6-baea-d5514ab0b311 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:59.794895 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:59.795577 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] REQUEST_METHOD: `PUT` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.795858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.796130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] PATH_INFO: `/v3/projects/9f36ef7b74094101b399132d10c420a4/users/addbddb72d354cf28d44e8c0fb192f98/roles/b24f159614534214a245691482a99191` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.808357 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:59.813222 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f36ef7b74094101b399132d10c420a4, user_id=addbddb72d354cf28d44e8c0fb192f98, role_id=b24f159614534214a245691482a99191)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:59.816082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:59.831805 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1448/2906] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:59 2022] PUT /identity/v3/projects/9f36ef7b74094101b399132d10c420a4/users/addbddb72d354cf28d44e8c0fb192f98/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:59.843317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:59.843595 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:59.843861 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:59.873045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] MFA Rules not processed for user `addbddb72d354cf28d44e8c0fb192f98`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:59.874259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:59.951250 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1459/2907] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:59.955745 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.022873 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3dfad-4488-4807-bda2-23de0c604efe admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.029234 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.029865 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.030130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.030396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.031045 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.033003 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.060831 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1449/2908] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:59 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:00.064870 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.077745 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbb924-b79e-4c1b-bf63-908660d4e9f3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.112424 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:00.136815 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.137432 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.137707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.137979 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] PATH_INFO: `/v3/users` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.138605 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.140514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.162098 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1460/2909] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:00 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:00.167433 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.177810 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d0d1-d95e-4114-9d9c-17963d7e20ec admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.182517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.183102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.183375 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.183646 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.184289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.185925 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.197832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1450/2910] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:00.202108 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.213506 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046de19c-b9b2-4122-b5e0-b5ddf3a042dc admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.218361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.219005 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.219282 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.219554 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] PATH_INFO: `/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8/users/ace34074985448deb5c2b7bc5587523f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.236787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9b5793c6ea4624a018a2a4287ed6a8, user_id=ace34074985448deb5c2b7bc5587523f, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.239456 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.253237 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1461/2911] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:00 2022] PUT /identity/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8/users/ace34074985448deb5c2b7bc5587523f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:00.257442 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.267412 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90646e-234d-4316-b460-7d90ccd2cb61 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.335991 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.336497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.336832 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.337210 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.338669 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.340576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08579a53-76d6-4a6e-ab9e-1a859384fbd3 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.350496 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1451/2912] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:00.355127 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.365751 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d107cf-c8ab-4dbb-9292-5351715d6e53 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.370514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.371166 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.371444 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.371716 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] PATH_INFO: `/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8/users/ace34074985448deb5c2b7bc5587523f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.373666 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9b5793c6ea4624a018a2a4287ed6a8, user_id=ace34074985448deb5c2b7bc5587523f, role_id=8f7b507c61c145d1bc046fb6b4fb9e0e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.376268 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.388182 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1462/2913] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:00 2022] PUT /identity/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8/users/ace34074985448deb5c2b7bc5587523f/roles/8f7b507c61c145d1bc046fb6b4fb9e0e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:00.400880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.401258 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.401759 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.430015 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] MFA Rules not processed for user `ace34074985448deb5c2b7bc5587523f`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:00.431291 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:00.486270 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:00.511050 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1452/2914] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:00.524148 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.526616 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:00.585752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614d7d3-143b-4c3b-9b8c-71eafa9b8032 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.594834 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.595452 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.595723 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.595992 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.658707 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.660189 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.670560 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1463/2915] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:02.020019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:02.021720 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.090084 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbababa-0f4a-4c12-8a83-95664467a716 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:02.101517 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:02.103147 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.103426 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.103694 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.105828 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.187614 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:02.189095 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:02.199456 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1453/2916] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:02.217255 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:02.218794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.231192 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ef0a-43dd-444c-b342-cc0a2aae5655 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:02.235054 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:02.235758 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.236130 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.236467 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.287088 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:02.305027 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:02.306500 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:02.316395 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1464/2917] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:03.295319 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:03.305364 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb988-3671-43bf-9ad4-838a5f4b12b8 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:03.309218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:03.309891 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.310373 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.310713 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.320382 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:03.322812 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:03.333166 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1454/2918] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:04.122215 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:04.123728 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:04.220735 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31792936-f74f-41c1-9c10-7f5ebc88da88 service cinder] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:04.227260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '211155364dfd4a60bc13efa3c7d7fa98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:04.229747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.229747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.229747 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:04.231558 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:04.247633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:04.249335 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b67617-3cd1-4d47-9a05-6d8dbf301af2 service nova] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:04.261981 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1465/2919] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:07.347001 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.410500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5699ee-75f1-42de-a509-28141d3e7087 service cinder] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.414960 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.415616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.415892 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.416160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] PATH_INFO: `/v3/users/099cd3c75f11444d8a2db5eba320c48a` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.417293 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099cd3c75f11444d8a2db5eba320c48a)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.419202 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:07.441468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:07.466427 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099cd3c75f11444d8a2db5eba320c48a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.473515 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099cd3c75f11444d8a2db5eba320c48a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.474128 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099cd3c75f11444d8a2db5eba320c48a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.474737 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099cd3c75f11444d8a2db5eba320c48a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.486871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099cd3c75f11444d8a2db5eba320c48a'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.499101 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1455/2920] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:07 2022] DELETE /identity/v3/users/099cd3c75f11444d8a2db5eba320c48a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:07.503608 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.504122 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.504260 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.524355 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:07.526644 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:07.589727 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1466/2921] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:07.599441 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.600854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:07.658880 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d17a5-4769-4176-9895-6f416feeff43 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.662500 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.663102 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.663377 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.663644 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.673036 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.674475 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:07.684436 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1456/2922] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:07.958010 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.959477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:07.974244 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9311d1-0332-44ef-a9bb-23399ecd4dcb None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.980343 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.981407 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.981984 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.982356 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] PATH_INFO: `/v3/projects/2385600649024b919a0b190f7af5f365` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.984173 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2385600649024b919a0b190f7af5f365)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.986866 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.040218 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2385600649024b919a0b190f7af5f365', 'request_id': 'req-d3e73de0-cb77-475f-afcc-09cab3115a6b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.046915 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2385600649024b919a0b190f7af5f365', 'request_id': 'req-d3e73de0-cb77-475f-afcc-09cab3115a6b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.055229 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2385600649024b919a0b190f7af5f365', 'request_id': 'req-d3e73de0-cb77-475f-afcc-09cab3115a6b'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.057813 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:08.069066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] The token cache is being invalidate because project 2385600649024b919a0b190f7af5f365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:08.069570 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.070206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.071914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1467/2923] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:07 2022] DELETE /identity/v3/projects/2385600649024b919a0b190f7af5f365 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:08.075852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.085553 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedd4a-bbf0-4462-9904-9cbb16fb9931 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.145192 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.145829 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.146108 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.146378 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] PATH_INFO: `/v3/users/addbddb72d354cf28d44e8c0fb192f98` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.147766 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] RBAC: Authorizing `identity:delete_user(user_id=addbddb72d354cf28d44e8c0fb192f98)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.149729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.195112 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:08.196662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addbddb72d354cf28d44e8c0fb192f98'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.205468 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addbddb72d354cf28d44e8c0fb192f98'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.206289 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addbddb72d354cf28d44e8c0fb192f98'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.206902 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addbddb72d354cf28d44e8c0fb192f98'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.220227 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addbddb72d354cf28d44e8c0fb192f98'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.232999 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1457/2924] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:08 2022] DELETE /identity/v3/users/addbddb72d354cf28d44e8c0fb192f98 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:08.544110 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.546257 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.562748 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73de0-cb77-475f-afcc-09cab3115a6b admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.628476 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.629578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.630107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.630599 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] PATH_INFO: `/v3/projects/9f36ef7b74094101b399132d10c420a4` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.632502 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f36ef7b74094101b399132d10c420a4)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.637591 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.690348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f36ef7b74094101b399132d10c420a4', 'request_id': 'req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.696612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f36ef7b74094101b399132d10c420a4', 'request_id': 'req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.705014 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f36ef7b74094101b399132d10c420a4', 'request_id': 'req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.716131 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] The token cache is being invalidate because project 9f36ef7b74094101b399132d10c420a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:08.716419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.717092 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.718578 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1468/2925] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:08 2022] DELETE /identity/v3/projects/9f36ef7b74094101b399132d10c420a4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:08.722581 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.724018 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.737184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e53271-5191-4241-ba75-48fe33fc651e admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.794592 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.795225 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.795497 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.795763 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] PATH_INFO: `/v3/users/ace34074985448deb5c2b7bc5587523f` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.796931 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace34074985448deb5c2b7bc5587523f)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.798883 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.848098 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace34074985448deb5c2b7bc5587523f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.856082 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace34074985448deb5c2b7bc5587523f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.856819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace34074985448deb5c2b7bc5587523f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.857488 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace34074985448deb5c2b7bc5587523f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.870435 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace34074985448deb5c2b7bc5587523f'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:08.882923 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1458/2926] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:08 2022] DELETE /identity/v3/users/ace34074985448deb5c2b7bc5587523f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:09.165551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.168537 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.181976 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd9f7f-0a5d-475a-a258-7bbf28ab51df admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.243087 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.243732 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.244006 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.244275 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] PATH_INFO: `/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.245419 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9b5793c6ea4624a018a2a4287ed6a8)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.247361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.281699 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:09.313640 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9b5793c6ea4624a018a2a4287ed6a8', 'request_id': 'req-0a115cda-8ae3-4bca-8b49-e87688b39bed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.319934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9b5793c6ea4624a018a2a4287ed6a8', 'request_id': 'req-0a115cda-8ae3-4bca-8b49-e87688b39bed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.328499 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9b5793c6ea4624a018a2a4287ed6a8', 'request_id': 'req-0a115cda-8ae3-4bca-8b49-e87688b39bed'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.340079 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] The token cache is being invalidate because project bd9b5793c6ea4624a018a2a4287ed6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:09.340362 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.341043 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-0a115cda-8ae3-4bca-8b49-e87688b39bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.342514 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1469/2927] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:09 2022] DELETE /identity/v3/projects/bd9b5793c6ea4624a018a2a4287ed6a8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:18.540218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:18.541728 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:18.555724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9236c1-b3f8-4ef8-b619-8ee511783241 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:18.597817 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:18.619413 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:18.620042 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:18.620314 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:18.620584 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] PATH_INFO: `/v3/users/dd0608a99f5c4ea6a7f7769429a8df14` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:18.622419 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0608a99f5c4ea6a7f7769429a8df14)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:18.624422 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:18.673531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0608a99f5c4ea6a7f7769429a8df14'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:18.682172 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0608a99f5c4ea6a7f7769429a8df14'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:18.682988 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0608a99f5c4ea6a7f7769429a8df14'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:18.683922 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0608a99f5c4ea6a7f7769429a8df14'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:18.696723 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0608a99f5c4ea6a7f7769429a8df14'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:18.709560 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1459/2928] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:18 2022] DELETE /identity/v3/users/dd0608a99f5c4ea6a7f7769429a8df14 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:18.714313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:18.714934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:18.714934 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:18.746612 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:18.747936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:18.819213 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1470/2929] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:18.829724 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:18.831271 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:18.894738 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2eaf6-c551-4e6f-a8e2-e4f56ff638e9 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:18.898655 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:18.899295 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:18.899573 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:18.899844 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:18.911616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:18.913230 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7c8d9-7dc8-44a5-8706-83801a46615e service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:18.924196 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1460/2930] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:19.214168 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.216373 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:19.235453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290672b4-07d7-4242-bd8d-654d23ab4290 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.241549 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.242382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.242690 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.242961 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] PATH_INFO: `/v3/projects/36f93e4c2d8b4c9b8c7bb526132c6e1e` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.244140 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f93e4c2d8b4c9b8c7bb526132c6e1e)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.246116 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.306637 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f93e4c2d8b4c9b8c7bb526132c6e1e', 'request_id': 'req-00213f80-66bc-448d-94fe-8ab46498be2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:19.315782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f93e4c2d8b4c9b8c7bb526132c6e1e', 'request_id': 'req-00213f80-66bc-448d-94fe-8ab46498be2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:19.325940 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f93e4c2d8b4c9b8c7bb526132c6e1e', 'request_id': 'req-00213f80-66bc-448d-94fe-8ab46498be2a'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:19.336477 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] The token cache is being invalidate because project 36f93e4c2d8b4c9b8c7bb526132c6e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:19.336782 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:19.337421 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-00213f80-66bc-448d-94fe-8ab46498be2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:19.338917 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1471/2931] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:19 2022] DELETE /identity/v3/projects/36f93e4c2d8b4c9b8c7bb526132c6e1e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:19.344562 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.344852 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.345129 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.366200 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:19.367342 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:19.436972 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1461/2932] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:19.445551 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.445872 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.446152 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.467361 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:19.468597 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:19.476701 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1472/2933] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:19.481183 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.487459 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:19.493632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1358f2-c2af-4e91-b3c8-dae37513c37c None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.503851 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.505085 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.505632 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.506151 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.506840 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81677) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:19.507156 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.508790 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.523178 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1462/2934] 10.222.0.70 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:19.527188 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.537516 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f52e41-e226-4189-b2bc-7c1d844aafb3 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.544936 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.545584 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.545864 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.546136 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.546781 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.548708 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.581107 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1473/2935] 10.222.0.70 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:19 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:19.582218 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.592874 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73506-1708-4cb7-8acd-eec732cc3c56 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.650711 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.651310 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.651585 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.651854 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] PATH_INFO: `/v3/users` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.653047 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.654958 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.679028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1463/2936] 10.222.0.70 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:19 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:55:19.683366 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.695081 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2376-6721-498f-9537-2c902b455f16 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.699962 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.700571 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.700878 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.701154 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.701794 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.703386 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.704860 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:19.716071 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1474/2937] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:19.720160 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.730361 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df64fcb-94c8-410e-b9bb-d7ebcaf7b640 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.735833 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.736438 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.736716 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.737019 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.737662 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.739267 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1c989-f10e-4bbf-91f7-3ed625baf4cd admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.750548 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1464/2938] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:19.755170 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.766317 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b83ad-7078-4eaf-806e-108352148181 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.771055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.771711 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.771989 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.772524 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] PATH_INFO: `/v3/projects/c3488686a5854057840ea41add3195bd/users/f6482675e2dd4cd191072f9af78cb097/roles/b24f159614534214a245691482a99191` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.788627 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3488686a5854057840ea41add3195bd, user_id=f6482675e2dd4cd191072f9af78cb097, role_id=b24f159614534214a245691482a99191)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:19.791340 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:19.806319 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1475/2939] 10.222.0.70 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:19 2022] PUT /identity/v3/projects/c3488686a5854057840ea41add3195bd/users/f6482675e2dd4cd191072f9af78cb097/roles/b24f159614534214a245691482a99191 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:19.816992 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] REQUEST_METHOD: `POST` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.817286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.817554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:19.847900 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.auth.core [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] MFA Rules not processed for user `f6482675e2dd4cd191072f9af78cb097`. Rule list: `[]` (Enabled: `True`). {{(pid=81677) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:19.849170 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:19.916927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1465/2940] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:19.928877 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:19.930615 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:19.992365 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd958-c23f-4cbd-9519-22399df4aae2 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:19.996322 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '252058d963a641a68e526a016ff50031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:19.997630 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:19.997905 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:19.998181 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:20.007066 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:20.008511 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fe405-9121-4e48-8151-390aea313184 service cinder] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:20.017844 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1476/2941] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:29.913696 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:30.013695 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:54.217932 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:54.282157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ae03e-4e58-4fcf-b0c2-d65a911a72b8 None None] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:54.286633 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:54.287254 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:54.287531 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:54.287802 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] PATH_INFO: `/v3/users/f6482675e2dd4cd191072f9af78cb097` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:54.288941 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6482675e2dd4cd191072f9af78cb097)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:54.290857 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:54.346362 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6482675e2dd4cd191072f9af78cb097'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.354080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6482675e2dd4cd191072f9af78cb097'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.354819 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6482675e2dd4cd191072f9af78cb097'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.355554 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6482675e2dd4cd191072f9af78cb097'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.367990 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6482675e2dd4cd191072f9af78cb097'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.380306 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1466/2942] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:54 2022] DELETE /identity/v3/users/f6482675e2dd4cd191072f9af78cb097 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:54.384808 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:54.385315 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:54.385426 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:54.408206 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] MFA Rules not processed for user `fe1519f75f3640c8b90717953b8356e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:54.409495 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:54.469822 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1477/2943] 10.222.0.70 () {58 vars in 958 bytes} [Wed Aug 31 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:54.479474 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:54.480942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:54.540527 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbdf92-bccf-434f-8268-42eb3010d4b7 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:54.544158 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ea57d0513345ab8a0910ac780d7b32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:54.544779 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:54.545059 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:54.545405 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:54.554602 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:54.556025 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:54.565576 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1467/2944] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:54.836480 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:54.838055 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:54.850830 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5268aa-68be-4b29-ab9f-72fa91114831 None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:54.855488 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:54.856401 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:54.856687 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:54.857007 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] PATH_INFO: `/v3/projects/c3488686a5854057840ea41add3195bd` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:54.858836 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3488686a5854057840ea41add3195bd)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:54.860787 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:54.909746 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3488686a5854057840ea41add3195bd', 'request_id': 'req-ce09cee3-fac3-40c0-8ff3-84dd594adee9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.915674 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3488686a5854057840ea41add3195bd', 'request_id': 'req-ce09cee3-fac3-40c0-8ff3-84dd594adee9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.923520 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3488686a5854057840ea41add3195bd', 'request_id': 'req-ce09cee3-fac3-40c0-8ff3-84dd594adee9'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.933916 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] The token cache is being invalidate because project c3488686a5854057840ea41add3195bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81678) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:54.934196 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.934811 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-ce09cee3-fac3-40c0-8ff3-84dd594adee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:54.937076 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1478/2945] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:54 2022] DELETE /identity/v3/projects/c3488686a5854057840ea41add3195bd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:04.561535 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:04.930914 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:39.782729 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:39.785309 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:39.858072 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551a2a1-58c5-453a-bf1f-5d9d1d8d8358 service neutron] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:39.923017 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:39.923628 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:39.924044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:39.924157 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:39.926007 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:39.937942 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:39.939542 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:39.950138 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1468/2946] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:41.632953 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] REQUEST_METHOD: `POST` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.633696 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.633865 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.654091 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.auth.core [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] MFA Rules not processed for user `e008960a52884d03a887c3f356021795`. Rule list: `[]` (Enabled: `True`). {{(pid=81678) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:41.655287 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:41.710337 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1479/2947] 10.222.0.70 () {58 vars in 967 bytes} [Wed Aug 31 10:57:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:41.757690 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:41.759078 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:41.829710 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a101128-7608-45e1-b8d4-c3518f270f43 service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:41.835616 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c051c9e64b2b4d16958cf716d3f6ff36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:41.836284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:41.836565 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:41.836871 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:41.845245 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:41.847061 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:41.855130 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1469/2948] 10.222.0.70 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:45.408285 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:45.410415 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:45.427752 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d38b0c-8892-46b3-9edd-a6034f4b08fc None None] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:45.433528 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:45.435453 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] REQUEST_METHOD: `GET` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:45.435845 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:45.436313 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:45.438348 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:45.452897 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:45.454504 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:45.471298 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1480/2949] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:48.520911 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.532528 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6493f0-3bda-4cb1-8c7d-7ad4a1763f64 service swift] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.537785 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72b84b6ae6034eefabc8156213f20797', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '981900e50ea443c58e0ddce02bf8b5c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.538532 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] REQUEST_METHOD: `GET` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.538811 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.539080 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.541304 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.553275 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.554882 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.571661 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1470/2950] 10.222.0.70 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:48.590682 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.592163 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.666211 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853af21-95f8-4276-b6c7-2c372728511e service placement] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.671458 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.672084 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.672382 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.672651 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] PATH_INFO: `/v3/users/33e88a7322504d159ecbe8174e049512` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.673881 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e88a7322504d159ecbe8174e049512)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.676552 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.722892 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e88a7322504d159ecbe8174e049512'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:48.723487 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e88a7322504d159ecbe8174e049512'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:48.731145 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e88a7322504d159ecbe8174e049512'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:48.743867 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e88a7322504d159ecbe8174e049512'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:48.750538 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e88a7322504d159ecbe8174e049512'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:48.756414 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1481/2951] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:57:48 2022] DELETE /identity/v3/users/33e88a7322504d159ecbe8174e049512 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:48.940660 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.951645 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154547fc-eb3d-4ad8-b88b-d29d3500300c service placement] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.958046 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=100 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.014927 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.015470 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.015749 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.016023 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] PATH_INFO: `/v3/projects/db184ca9a62e4be9a373bf34aff978b5` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.017184 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db184ca9a62e4be9a373bf34aff978b5)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.019142 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.067268 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db184ca9a62e4be9a373bf34aff978b5', 'request_id': 'req-770788ad-31ca-4c50-b7c8-257667208e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.073395 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db184ca9a62e4be9a373bf34aff978b5', 'request_id': 'req-770788ad-31ca-4c50-b7c8-257667208e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.081415 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db184ca9a62e4be9a373bf34aff978b5', 'request_id': 'req-770788ad-31ca-4c50-b7c8-257667208e28'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.091906 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] The token cache is being invalidate because project db184ca9a62e4be9a373bf34aff978b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:57:49.092193 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.092858 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.094335 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1471/2952] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:57:48 2022] DELETE /identity/v3/projects/db184ca9a62e4be9a373bf34aff978b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:49.099720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.101259 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:49.116045 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0023af-9fda-477b-b236-191d4001f027 admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.123835 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.175085 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81678) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.175859 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.176139 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] SCRIPT_NAME: `/identity` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.176411 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] PATH_INFO: `/v3/users/567006c1464b4bac9025b0dc60d2ba89` {{(pid=81678) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.177626 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] RBAC: Authorizing `identity:delete_user(user_id=567006c1464b4bac9025b0dc60d2ba89)` {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.179523 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] RBAC: Authorization granted {{(pid=81678) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.227064 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567006c1464b4bac9025b0dc60d2ba89'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.227720 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567006c1464b4bac9025b0dc60d2ba89'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.234809 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567006c1464b4bac9025b0dc60d2ba89'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.246884 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567006c1464b4bac9025b0dc60d2ba89'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.254303 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.notifications [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567006c1464b4bac9025b0dc60d2ba89'} {{(pid=81678) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.260125 dv-cinder-846173-5-smb devstack@keystone.service[81678]: [pid: 81678|app: 0|req: 1482/2953] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Aug 31 10:57:49 2022] DELETE /identity/v3/users/567006c1464b4bac9025b0dc60d2ba89 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:49.436028 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Authenticating user token {{(pid=81677) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:49.437743 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.fernet_utils [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81677) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:49.452396 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770788ad-31ca-4c50-b7c8-257667208e28 admin admin] Validating token access rules against request {{(pid=81677) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:49.521360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe1519f75f3640c8b90717953b8356e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6872bf7790f84367af06df6d64db20b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81677) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:49.521360 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:49.522073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] SCRIPT_NAME: `/identity` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:49.522073 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] PATH_INFO: `/v3/projects/e2a7caf049234bfc998a21eff157373b` {{(pid=81677) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:49.523004 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a7caf049234bfc998a21eff157373b)` {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:49.524944 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] RBAC: Authorization granted {{(pid=81677) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:49.567241 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:49.574044 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a7caf049234bfc998a21eff157373b', 'request_id': 'req-8eeba521-dde2-4b42-b331-1cd364a6954e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.580358 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a7caf049234bfc998a21eff157373b', 'request_id': 'req-8eeba521-dde2-4b42-b331-1cd364a6954e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.589021 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a7caf049234bfc998a21eff157373b', 'request_id': 'req-8eeba521-dde2-4b42-b331-1cd364a6954e'} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.599383 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] The token cache is being invalidate because project e2a7caf049234bfc998a21eff157373b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81677) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:57:49.599666 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.600284 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG keystone.notifications [None req-8eeba521-dde2-4b42-b331-1cd364a6954e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81677) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:57:49.601778 dv-cinder-846173-5-smb devstack@keystone.service[81677]: [pid: 81677|app: 0|req: 1472/2954] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Aug 31 10:57:49 2022] DELETE /identity/v3/projects/e2a7caf049234bfc998a21eff157373b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:57:59.256803 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG dbcounter [-] [81678] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81678) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.596286 dv-cinder-846173-5-smb devstack@keystone.service[81677]: DEBUG dbcounter [-] [81677] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81677) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:01.961220 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Authenticating user token {{(pid=81678) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:01.962671 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.common.fernet_utils [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81678) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:02.099633 dv-cinder-846173-5-smb devstack@keystone.service[81678]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5e359-a18c-4303-abc5-255733bc297e admin admin] Validating token access rules against request {{(pid=81678) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}}